-- Logs begin at Tue 2021-11-09 04:18:24 UTC, end at Tue 2021-11-09 05:49:34 UTC. -- Nov 09 04:43:29.564255 dv-cinder-817135-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 09 04:43:29.577047 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 09 04:43:29.579648 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 9 04:43:29 2021] *** Nov 09 04:43:29.579783 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 09 04:43:29.579871 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 09 04:43:29.579955 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: nodename: dv-cinder-817135-2-iscsi Nov 09 04:43:29.580037 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: machine: x86_64 Nov 09 04:43:29.580121 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: clock source: unix Nov 09 04:43:29.580207 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: pcre jit disabled Nov 09 04:43:29.580289 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: detected number of CPU cores: 4 Nov 09 04:43:29.580371 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: current working directory: / Nov 09 04:43:29.580472 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: detected binary path: /usr/bin/uwsgi-core Nov 09 04:43:29.580472 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: your processes number limit is 47680 Nov 09 04:43:29.580472 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: your memory page size is 4096 bytes Nov 09 04:43:29.580472 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: detected max file descriptor number: 2048 Nov 09 04:43:29.580472 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: lock engine: pthread robust mutexes Nov 09 04:43:29.580805 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: thunder lock: enabled Nov 09 04:43:29.580865 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 09 04:43:29.580920 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 09 04:43:29.627979 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: Python main interpreter initialized at 0x5602a014c9c0 Nov 09 04:43:29.627979 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: python threads support enabled Nov 09 04:43:29.627979 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: your server socket listen backlog is limited to 100 connections Nov 09 04:43:29.627979 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: your mercy for graceful operations on workers is 90 seconds Nov 09 04:43:29.628342 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: mapped 403077 bytes (393 KB) for 2 cores Nov 09 04:43:29.628405 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: *** Operational MODE: preforking *** Nov 09 04:43:29.628694 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: *** uWSGI is running in multiple interpreter mode *** Nov 09 04:43:29.628694 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: spawned uWSGI master process (pid: 79018) Nov 09 04:43:29.628903 dv-cinder-817135-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 09 04:43:29.629963 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: spawned uWSGI worker 1 (pid: 79031, cores: 1) Nov 09 04:43:29.630830 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: spawned uWSGI worker 2 (pid: 79032, cores: 1) Nov 09 04:43:29.630830 dv-cinder-817135-2-iscsi devstack@keystone.service[79018]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 09 04:43:34.788302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:43:34.788302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: from cryptography.utils import int_from_bytes Nov 09 04:43:34.789082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:43:34.789082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: from cryptography.utils import int_from_bytes Nov 09 04:43:34.789082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:43:34.789082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: from cryptography.utils import int_from_bytes Nov 09 04:43:34.789578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 09 04:43:34.789578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: from cryptography.utils import int_from_bytes Nov 09 04:43:34.837449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:43:34.837576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 09 04:43:34.837576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:43:34.837723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 09 04:43:34.837806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] command line args: [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:43:34.837880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] command line args: [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 09 04:43:34.838023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:43:34.838107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 09 04:43:34.838183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ================================================================================ {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:43:34.838262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ================================================================================ {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 09 04:43:34.838434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] admin_token = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.838518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] admin_token = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.838678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] config_dir = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.838777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] config_dir = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] config_source = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] config_source = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] debug = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] debug = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.839967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.840983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841069 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_config_append = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_config_append = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_dir = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_dir = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_file = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.841934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_file = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.842935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843411 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.843997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844146 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.844929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.845098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.845180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.845374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.845462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.845859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.845957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] publish_errors = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] publish_errors = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.846911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] standard_threads = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] standard_threads = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.847953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] use_journal = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] use_journal = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] use_json = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] use_json = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] use_stderr = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] use_stderr = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] use_syslog = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] use_syslog = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.848932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.849006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 09 04:43:34.849186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.849262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.849427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.849500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.849684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.849758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.849927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.850988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.851921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.852975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.853948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.854128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.854204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.854388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.854475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.855948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.856914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.857938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.858898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.859873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.860958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.861901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.862898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.863909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.864986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.865949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.866994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.867963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.868937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.869859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.870989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.871842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.external = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.external = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.872990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.password = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.password = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] auth.token = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] auth.token = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.873995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.874964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.875943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.876906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.877890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.878922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.879953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.880901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.881891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.882852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.883990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884320 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.884954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.885941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.886954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.887990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.888993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.889979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.890944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.891927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.892913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.893962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.894898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.895888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.896987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.897936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.898979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.899951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.900903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.901062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.901137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.901297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.901872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.902870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.903856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.904984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.905939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] role.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] role.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] role.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.906965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] role.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.907971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.908951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.909918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.910942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.911958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.912995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.913939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.914897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915283 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.915860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.916826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.917016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.917103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.917796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.917878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.918987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.919998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.920079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.connection = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.920240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.920324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.connection = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.920489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.920818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.920983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.921996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.922965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.923929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:43:34.924806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 09 04:43:34.924938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 09 04:43:34.954383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.954528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.954602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.954692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.954829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.954913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.963227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.963354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.993598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.993828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.994917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:34.995177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.047861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.048562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.185939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.186168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.186646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.186883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.250385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.250619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.250710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.250847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.250931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.251766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.277223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.277455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.277683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.277906 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.278126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.278349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.278585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.278967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.279203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.279430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.279678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.279904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.280121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.280332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.289617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.290502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.302689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.302917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.303145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.303370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.303592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.303833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.304051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79031) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.307137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.307374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.307637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.307871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.308175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.308447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.308665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79032) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 09 04:43:35.326061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.326272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 09 04:43:35.326351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.326588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 09 04:43:35.326671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.326788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 09 04:43:35.327058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.327149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.327321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.327408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 09 04:43:35.327694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.327803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.327962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.328047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.328224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.328483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.338813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.339663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.339782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.339938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.342013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.343327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.343606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.343924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.352153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.354112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.355380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.355690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.355973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.356250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.356526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.356788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.357048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.357417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.357510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.357699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.357872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.357983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.358142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.358266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.358410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.358550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.358816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.359086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.359447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.359958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.360436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.360912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.386531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.388117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.388394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.388662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.390256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.390538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.393590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.393872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.394153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.395907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.396198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.396491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.401200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.402032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.404242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.404529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.406367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.406648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.406942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.407204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.407589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.407892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.408163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.408432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.408908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.409204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.409489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.409775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.410061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.410338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.410614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.410995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.426722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.426996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.429580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.429862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.431550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.434367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.435129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.435426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.438061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.438320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.440331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.443267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.443832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.446786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.447344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.447658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.447944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.448849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.449133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.449418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.450884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.451184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.451470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.451782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.452071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.452359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.468372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.468653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.468925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.469186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.471459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.471769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.472041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.472306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.476959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.478622 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.478891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.480174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.481870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.481955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.482149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.482232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.482435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.482729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.483006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.485209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.485493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.485787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.486073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.486352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.496024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.496297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.496570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.496845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.497120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.497406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.497679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.499423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.499744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.500028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.500313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.500598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.500891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.501182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.515476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.519052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.519925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.522227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.523393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.524970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.527100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.527327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.527423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.527666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.528935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.530527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.530807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.531097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.534845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.536405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.538193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.539520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.539762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.539913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.540098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.540381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.543057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.543366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.543655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.543943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.549457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.549739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.550019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.553032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.553321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.553603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.557787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79032) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.558125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.558341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.558609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.558875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.559148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.559414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.559720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.559988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.560257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.560523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.560787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.561046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.561306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79032) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.561618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79031) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 09 04:43:35.561901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.562182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.562459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.562732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.563020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.563308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.563597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.563894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.564164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.564440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.564715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.564981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.565250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79031) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 09 04:43:35.599149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602a014c9c0 pid: 79032 (default app) Nov 09 04:43:35.602465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8709-a9cc-4614-b10e-1ab8a7dfab24 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:35.602759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8709-a9cc-4614-b10e-1ab8a7dfab24 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:35.603034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba8709-a9cc-4614-b10e-1ab8a7dfab24 None None] PATH_INFO: `/v3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:35.603308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602a014c9c0 pid: 79031 (default app) Nov 09 04:43:35.607356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 791 bytes} [Tue Nov 9 04:43:35 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:43.257664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4393-b4e1-42f7-b34b-fd07ce8657ff None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:43.258187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4393-b4e1-42f7-b34b-fd07ce8657ff None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:43.258264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4393-b4e1-42f7-b34b-fd07ce8657ff None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:43.263903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:43 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:43:43.269619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:43.270047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:43.270181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:43.299318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG oslo_db.sqlalchemy.engines [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:43:43.485870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG passlib.handlers.bcrypt [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79032) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 09 04:43:43.486305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG passlib.handlers.bcrypt [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79032) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 09 04:43:43.540740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:43.542319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:43.673959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:43.835183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4393-b4e1-42f7-b34b-fd07ce8657ff None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:43.869250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG oslo_db.sqlalchemy.engines [None req-0d9c4393-b4e1-42f7-b34b-fd07ce8657ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 09 04:43:44.003450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4393-b4e1-42f7-b34b-fd07ce8657ff None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:44.009702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:44.010688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:44.011494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:44.011887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:44.021584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:44.076371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 09 04:43:44.076703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1394-2a31-48b5-b3be-aaa53285bda0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:44.087896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:43:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:43:44.094538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:44.109117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72ef37-7c07-4584-9334-e1afa1e701ac None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:44.113519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:44.114728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:44.115017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:44.115290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] PATH_INFO: `/v3/projects/98146912a4594b47b6620b2e1ee83d93` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:44.116841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] RBAC: Authorizing `identity:get_project(project_id=98146912a4594b47b6620b2e1ee83d93)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:44.172360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.common.rbac_enforcer.enforcer [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 09 04:43:44.172703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6f57-c4b1-4c51-8b20-245d5617935d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:44.178198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 3/5] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:43:44 2021] GET /identity/v3/projects/98146912a4594b47b6620b2e1ee83d93 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:46.405122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d45d48-516a-4f5a-891b-df0ff1ee00ec None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:46.405686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d45d48-516a-4f5a-891b-df0ff1ee00ec None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:46.405686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d45d48-516a-4f5a-891b-df0ff1ee00ec None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:46.410251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 3/6] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:46.416294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:46.416704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:46.416904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:46.436048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:46.437616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:46.445421 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:46.468858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d45d48-516a-4f5a-891b-df0ff1ee00ec None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:46.481085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d45d48-516a-4f5a-891b-df0ff1ee00ec None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:46.485279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35719ed4-4f9d-4d63-bbcf-840d7a3482d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:46.485915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35719ed4-4f9d-4d63-bbcf-840d7a3482d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:46.486204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35719ed4-4f9d-4d63-bbcf-840d7a3482d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:46.486485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35719ed4-4f9d-4d63-bbcf-840d7a3482d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:46.494014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35719ed4-4f9d-4d63-bbcf-840d7a3482d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:46.496464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35719ed4-4f9d-4d63-bbcf-840d7a3482d4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:46.504977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:43:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:43:46.510841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:46.522477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8374fd-f28e-4ac2-9947-41c280be0617 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:46.526978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f67143-7b1f-41e9-b3ff-d165f1a8e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:46.527886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67143-7b1f-41e9-b3ff-d165f1a8e2af admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:46.528176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67143-7b1f-41e9-b3ff-d165f1a8e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:46.528457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f67143-7b1f-41e9-b3ff-d165f1a8e2af admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:46.529867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f67143-7b1f-41e9-b3ff-d165f1a8e2af admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:46.531933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f67143-7b1f-41e9-b3ff-d165f1a8e2af admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:46.533501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 5/9] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:43:46 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:48.841219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b0e82-0468-4300-9999-9019c2a88ce4 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.841699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b0e82-0468-4300-9999-9019c2a88ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.841699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b0e82-0468-4300-9999-9019c2a88ce4 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.843453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:48.849337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc5de-eca1-4bdd-9db9-3a4f85cf62b0 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.849754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc5de-eca1-4bdd-9db9-3a4f85cf62b0 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.850014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bc5de-eca1-4bdd-9db9-3a4f85cf62b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.867161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5c2bc5de-eca1-4bdd-9db9-3a4f85cf62b0 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:48.868361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5c2bc5de-eca1-4bdd-9db9-3a4f85cf62b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:48.875756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 6/11] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:43:48.879400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2bc0c-3a8e-4ddd-b9c9-e72b3592f0da None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.879884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2bc0c-3a8e-4ddd-b9c9-e72b3592f0da None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.880235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2bc0c-3a8e-4ddd-b9c9-e72b3592f0da None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.882024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 6/12] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:48.888279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.888570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.888848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.900385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2bc0c-3a8e-4ddd-b9c9-e72b3592f0da None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:48.906412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:48.907590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:48.912581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2bc0c-3a8e-4ddd-b9c9-e72b3592f0da None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:48.915046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:48.916839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:48.917602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.917885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.918159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.933743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:43:48.937599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:48.940555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:43:48.942043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 7/14] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:43:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:43:48.946609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a4327-8d5a-41f8-9f3d-039c5bed3866 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:48.947791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:48.951953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:48.952599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.952886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.953165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.959937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c641d-f0a7-4764-bce8-b4f35c8927ff admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:48.961229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:48.963029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:48.964895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:48.965535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.965820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.966098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.966856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:43:48.967162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:48.968888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:48.968888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:43:48.968888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:43:48.969784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:48.972460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 8/15] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:43:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:43:48.978748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:48.983386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 8/16] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:43:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:48.987253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14129aee-1663-47f9-8421-7e1b2a807125 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:48.989360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:48.991899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:48.992672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:48.992962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:48.993246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:48.994446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:48.996185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:48.997725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 9/17] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:48.998524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8c98f-750f-4e84-9791-b0d34a63752c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:49.002889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:49.003812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:49.004097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:49.004372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:49.006168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:49.008161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:49.009872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 9/18] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:43:48 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:49.016824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:49.027731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47501cd1-a836-4e23-9b8c-f0097a703cd0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:49.032347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56419d-ed15-4809-8138-f4fdf54943fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:49.033167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56419d-ed15-4809-8138-f4fdf54943fd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:49.033456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56419d-ed15-4809-8138-f4fdf54943fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:49.033740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56419d-ed15-4809-8138-f4fdf54943fd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:49.034998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56419d-ed15-4809-8138-f4fdf54943fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:49.036788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56419d-ed15-4809-8138-f4fdf54943fd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:49.038458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 10/19] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:49.047414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:49.057704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef147-e59b-4d64-83cc-d814e3d7df5c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:49.062464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:49.063143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:49.063431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:49.063745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:49.064616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.domain.id=default, user.id=dce917494d344377a020b14e93b0e3e7) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:43:49.064932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:49.065950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:49.065950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:43:49.065950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:43:49.067138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9c120-e164-4fc9-9694-dc3442052ad2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:49.078202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 10/20] 10.222.0.41 () {56 vars in 1343 bytes} [Tue Nov 9 04:43:49 2021] GET /identity/v3/role_assignments?user.id=dce917494d344377a020b14e93b0e3e7&scope.domain.id=default&role.id=94424be31c964c5686644e854119e1dc => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:51.614716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94883677-f058-44d2-98e6-bf9843b7fe12 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.615738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94883677-f058-44d2-98e6-bf9843b7fe12 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.616219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94883677-f058-44d2-98e6-bf9843b7fe12 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:51.618719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 11/21] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:51.625206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.626025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.626503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:51.664706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG passlib.handlers.bcrypt [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79031) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 09 04:43:51.665451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG passlib.handlers.bcrypt [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79031) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 09 04:43:51.712965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:51.715804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:51.750106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:51.786781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94883677-f058-44d2-98e6-bf9843b7fe12 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:51.800126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94883677-f058-44d2-98e6-bf9843b7fe12 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:51.810216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:51.811282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.811801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.812339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:51.837744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:43:51.846186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:43:51.848046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 12/23] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:43:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:43:51.855002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:51.864734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1805529-f402-40e5-bc23-79d0e7ee0867 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:51.875223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:51.876558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.877049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.877546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:51.878699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:43:51.879203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:51.881092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:51.896808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 12/24] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:43:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:51.903908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:51.914437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51bcc8-4cf9-4bc3-bbc9-0a1c38da4e2c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:51.923974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:51.925249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.925740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.926267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:51.927970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:51.930118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:51.932247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 13/25] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:43:51 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:51.938691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:51.949994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a16eaa-e83a-4064-b9de-54b453b86b60 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:51.959534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb081067-d691-462a-87a5-56363f5162c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:51.960713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb081067-d691-462a-87a5-56363f5162c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.961216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb081067-d691-462a-87a5-56363f5162c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.961688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb081067-d691-462a-87a5-56363f5162c6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:51.963338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb081067-d691-462a-87a5-56363f5162c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:51.965869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb081067-d691-462a-87a5-56363f5162c6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:51.968017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 13/26] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:51.974090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:51.988759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf18e2-0a31-402f-bf5d-fec0162b294f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:51.996309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:51.997546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:51.997828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:51.998111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] PATH_INFO: `/v3/domains/default/users/dce917494d344377a020b14e93b0e3e7/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.005433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dce917494d344377a020b14e93b0e3e7, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:52.007213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:52.007213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:43:52.007213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:43:52.009226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1901e6d-aa59-4cfe-841f-e9e269dd328d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:52.141710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896667-998b-4572-b0d7-c4308de8248b None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.142346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896667-998b-4572-b0d7-c4308de8248b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.142849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44896667-998b-4572-b0d7-c4308de8248b None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.146894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 14/27] 10.222.0.41 () {58 vars in 1382 bytes} [Tue Nov 9 04:43:51 2021] PUT /identity/v3/domains/default/users/dce917494d344377a020b14e93b0e3e7/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:43:52.148813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 14/28] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:52 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:52.162324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade0f77-65a2-4b15-9843-9534eb69053d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.162633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade0f77-65a2-4b15-9843-9534eb69053d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.162897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade0f77-65a2-4b15-9843-9534eb69053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.193099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-9ade0f77-65a2-4b15-9843-9534eb69053d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:52.194692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9ade0f77-65a2-4b15-9843-9534eb69053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:52.268277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 15/29] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:43:52.332787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896667-998b-4572-b0d7-c4308de8248b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:52.345837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44896667-998b-4572-b0d7-c4308de8248b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:52.355607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:52.356864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.357354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.357831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.379961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:52.382221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:52.386242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e97a-bb1f-491c-8af9-f5a4c2ff1f13 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.386829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e97a-bb1f-491c-8af9-f5a4c2ff1f13 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.387304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e97a-bb1f-491c-8af9-f5a4c2ff1f13 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.396549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:52 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:43:52.401425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:43:52.402942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 15/31] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:43:52.403217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.403740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.404242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.409271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:52.420253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85962ec-821d-4207-8a7d-83dbf039fec0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:52.428512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:52.429209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.429500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.429784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.435653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:43:52.435653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:52.435653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:52.435653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:43:52.435653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:43:52.435653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:52.437529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:52.439024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:52.471784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 16/32] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:43:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:52.474375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 17/33] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:43:52.483262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:52.493506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138af3f-6206-458b-9353-5e7eb01ce626 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:52.503612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:52.504331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.504620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.504905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.505649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:52.506670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:52.506670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:43:52.506670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:43:52.508038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70107321-f787-4c6d-aec1-b51b74b56de0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:52.514478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:52.532178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f779-1205-4b35-8776-644b619d4431 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:52.537667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:52.538591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.539104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.539584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.540610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:52.542568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:52.542568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:43:52.542568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:43:52.543909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b815ac-a00a-4f29-b3ae-e9c2960c789e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:52.575753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 18/34] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/roles => generated 219 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:43:52.673264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 17/35] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/projects => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:43:52.757573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1059-e436-4f41-b724-a1d67a0865e9 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.758582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1059-e436-4f41-b724-a1d67a0865e9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.759078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e1059-e436-4f41-b724-a1d67a0865e9 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.761601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:52.768608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46f18-91d0-4019-95dd-52e5d190f1bc None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.769255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46f18-91d0-4019-95dd-52e5d190f1bc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.769787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46f18-91d0-4019-95dd-52e5d190f1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.800904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-24e46f18-91d0-4019-95dd-52e5d190f1bc None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:52.802912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-24e46f18-91d0-4019-95dd-52e5d190f1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:52.897930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 18/37] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:43:52.941940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e1059-e436-4f41-b724-a1d67a0865e9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:52.958023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e1059-e436-4f41-b724-a1d67a0865e9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:52.968436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:52.969516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.970016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.970504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.971560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:52.973451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:52.980653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8fc42-23b9-4fe2-96bd-858190c0bbe2 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.981430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8fc42-23b9-4fe2-96bd-858190c0bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.982058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8fc42-23b9-4fe2-96bd-858190c0bbe2 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:52.984567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 19/38] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:43:52.992631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5079c-4ff1-4871-9308-c3d5f947ab77 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:52.993269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5079c-4ff1-4871-9308-c3d5f947ab77 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:52.993813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5079c-4ff1-4871-9308-c3d5f947ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:53.008344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 20/39] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/roles => generated 223 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:43:53.022176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e1c5079c-4ff1-4871-9308-c3d5f947ab77 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:53.023891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e1c5079c-4ff1-4871-9308-c3d5f947ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:53.034772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 20/40] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:53.074717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:53.085634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ec802-5a80-4ab9-8cf4-ae58750dea7c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:53.093249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09c9e3-4885-4241-aeef-24ca1b108aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:53.094366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c9e3-4885-4241-aeef-24ca1b108aec admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:53.094907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c9e3-4885-4241-aeef-24ca1b108aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:53.095399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09c9e3-4885-4241-aeef-24ca1b108aec admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:53.096578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09c9e3-4885-4241-aeef-24ca1b108aec admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:53.098575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09c9e3-4885-4241-aeef-24ca1b108aec admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:53.118802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 21/41] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:43:53 2021] POST /identity/v3/roles => generated 225 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:43:53.616257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17c8d-05f5-45ef-9405-d5ff7309fa53 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:53.616548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17c8d-05f5-45ef-9405-d5ff7309fa53 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:53.616833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac17c8d-05f5-45ef-9405-d5ff7309fa53 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:53.618617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 21/42] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:53.625125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:53.625423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:53.625715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:53.643736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:53.644933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:53.652602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 22/43] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:43:53.676350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17c8d-05f5-45ef-9405-d5ff7309fa53 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:53.689921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac17c8d-05f5-45ef-9405-d5ff7309fa53 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:53.694455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34da3f-81e7-4461-ae43-404c18238256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:53.695297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34da3f-81e7-4461-ae43-404c18238256 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:53.695607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34da3f-81e7-4461-ae43-404c18238256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:53.695959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34da3f-81e7-4461-ae43-404c18238256 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:53.697249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34da3f-81e7-4461-ae43-404c18238256 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:53.700030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34da3f-81e7-4461-ae43-404c18238256 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:53.701919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 22/44] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:53.708837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:53.718056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2003c-edab-433e-ba8b-6efbb0323e13 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:53.722464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:53.723126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:53.723418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:53.723746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:53.724492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:53.725512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:53.725512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:43:53.725512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:43:53.726742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582ab0-613d-46cf-94a5-332019b42568 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:53.752907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 23/45] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:43:53 2021] POST /identity/v3/projects => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:43:54.777509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083098-ce9b-45c9-bb32-76fdc94b33c7 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:54.778012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083098-ce9b-45c9-bb32-76fdc94b33c7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:54.778119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083098-ce9b-45c9-bb32-76fdc94b33c7 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:54.779916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 23/46] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:54.785982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:54.786382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:54.786560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:54.804771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:54.805970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:54.861423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 24/47] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:54.886205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083098-ce9b-45c9-bb32-76fdc94b33c7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:54.898215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083098-ce9b-45c9-bb32-76fdc94b33c7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:54.902575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:54.903431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:54.903758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:54.904042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:54.914024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:43:54.921631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:43:54.922800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 24/48] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:43:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:43:54.929154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:54.939012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17151e25-d0da-4a4f-ab25-79a6c5063b37 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:54.943567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:54.944305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:54.944597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:54.944885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:54.945685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:43:54.946001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:54.947047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:54.947047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:43:54.947047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:43:54.948013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:54.961472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 25/49] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:43:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:54.967493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:54.977641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479df18c-d960-40dc-a5f3-4b43233971ff admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:54.982552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:54.983407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:54.983733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:54.984022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:54.985453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:54.987279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:54.988881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 25/50] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:43:54 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:54.994566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:55.004744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ccca9-e26c-432a-9dd2-02bdc3ce24b6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:55.009104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc639f-718e-4ae7-8a8b-1fbf1020abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:55.009886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc639f-718e-4ae7-8a8b-1fbf1020abe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:55.010179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc639f-718e-4ae7-8a8b-1fbf1020abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:55.010461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc639f-718e-4ae7-8a8b-1fbf1020abe8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:55.011690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc639f-718e-4ae7-8a8b-1fbf1020abe8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:55.013427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc639f-718e-4ae7-8a8b-1fbf1020abe8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:55.015149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 26/51] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:43:55.021572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:55.031269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725fbb1-3ed6-40ce-a412-d3f50f3473b8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:55.035707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:55.036353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:55.036644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:55.036926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:55.037772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.domain.id=default, user.id=dce917494d344377a020b14e93b0e3e7) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:43:55.038090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:55.040058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f398-99f7-493d-9e3c-329da239b68f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:55.046714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 26/52] 10.222.0.41 () {56 vars in 1343 bytes} [Tue Nov 9 04:43:55 2021] GET /identity/v3/role_assignments?user.id=dce917494d344377a020b14e93b0e3e7&scope.domain.id=default&role.id=94424be31c964c5686644e854119e1dc => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:56.003852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67688f-7725-4136-85d3-7e97085bc71e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:56.004400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67688f-7725-4136-85d3-7e97085bc71e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:56.004400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67688f-7725-4136-85d3-7e97085bc71e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:56.006228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 27/53] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:56.012149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:56.012559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:56.012717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:56.031365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:56.032605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:56.039974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 27/54] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:43:56.069447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67688f-7725-4136-85d3-7e97085bc71e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:56.082055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67688f-7725-4136-85d3-7e97085bc71e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:56.086291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287d622-f773-4e7c-9bbd-79f38545952e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:56.087078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d622-f773-4e7c-9bbd-79f38545952e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:56.087372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d622-f773-4e7c-9bbd-79f38545952e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:56.087686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287d622-f773-4e7c-9bbd-79f38545952e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:56.089448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287d622-f773-4e7c-9bbd-79f38545952e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:56.091141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287d622-f773-4e7c-9bbd-79f38545952e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:56.092745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 28/55] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:56.098740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:56.108201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b43f1-d2b2-4573-854f-2e8cd35e9ad1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:56.112615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1252362-f9d6-43e3-965f-baeebc275aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:56.113266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1252362-f9d6-43e3-965f-baeebc275aee admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:56.113555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1252362-f9d6-43e3-965f-baeebc275aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:56.113839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1252362-f9d6-43e3-965f-baeebc275aee admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:56.114571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1252362-f9d6-43e3-965f-baeebc275aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:56.116529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1252362-f9d6-43e3-965f-baeebc275aee admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:56.139955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 28/56] 10.222.0.41 () {60 vars in 1161 bytes} [Tue Nov 9 04:43:56 2021] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:43:58.402520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e7840-7806-4099-b1b6-3aa2a16da19e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:58.403035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e7840-7806-4099-b1b6-3aa2a16da19e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:58.403139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e7840-7806-4099-b1b6-3aa2a16da19e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:58.404895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 29/57] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:43:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:43:58.410802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:58.411209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:58.411376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:58.429855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:43:58.431046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:43:58.486536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 29/58] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:43:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:43:58.512242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e7840-7806-4099-b1b6-3aa2a16da19e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:58.523961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e7840-7806-4099-b1b6-3aa2a16da19e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:58.528130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdce1b5-b155-4ac1-bb21-774c72880f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:58.528902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce1b5-b155-4ac1-bb21-774c72880f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:58.529188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce1b5-b155-4ac1-bb21-774c72880f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:58.529468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce1b5-b155-4ac1-bb21-774c72880f59 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:58.530646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdce1b5-b155-4ac1-bb21-774c72880f59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:58.532390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdce1b5-b155-4ac1-bb21-774c72880f59 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:58.533958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 30/59] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:43:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:43:58.539486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:43:58.548964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692812a9-1db9-446e-acdb-21e19cc2c43f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:43:58.553316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:43:58.554007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:43:58.554296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:43:58.554579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:43:58.555309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:43:58.556364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:43:58.556364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:43:58.556364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:43:58.558223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe8ac-a399-4202-a13c-4114ce8369d7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:43:58.582033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 30/60] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:43:58 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:02.085121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee151f6-2912-4e16-86e6-2bfe9159e8ab None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.086271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee151f6-2912-4e16-86e6-2bfe9159e8ab None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.086777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee151f6-2912-4e16-86e6-2bfe9159e8ab None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.089340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 31/61] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:02.095830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a633a22-37c4-4d54-b5b1-75bfe90345a6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.096813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a633a22-37c4-4d54-b5b1-75bfe90345a6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.097311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a633a22-37c4-4d54-b5b1-75bfe90345a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.116504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9a633a22-37c4-4d54-b5b1-75bfe90345a6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:02.118197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9a633a22-37c4-4d54-b5b1-75bfe90345a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:02.136778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 31/62] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:02.161112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee151f6-2912-4e16-86e6-2bfe9159e8ab None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.181269 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee151f6-2912-4e16-86e6-2bfe9159e8ab None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.185056 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb813-f1b9-48f6-86b4-d047c319d6ec None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.185356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb813-f1b9-48f6-86b4-d047c319d6ec None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.185897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6edb813-f1b9-48f6-86b4-d047c319d6ec None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.188264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 32/63] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:02.191256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.192281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.192635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.192983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.194338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d242-8a7c-45d9-8121-07bfe0bc93f6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.194653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d242-8a7c-45d9-8121-07bfe0bc93f6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.194984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d242-8a7c-45d9-8121-07bfe0bc93f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.209826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:02.216860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:02.223460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 32/64] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:02.224792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.227502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8168d242-8a7c-45d9-8121-07bfe0bc93f6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:02.229521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8168d242-8a7c-45d9-8121-07bfe0bc93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:02.235692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c776ad-6c56-4801-9d5f-c319dd37f059 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.243349 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.244194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.244612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.245479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.246462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:02.246841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.248847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.251739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 33/65] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 09 04:44:02.253135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0521e2-3e75-4033-9dd1-33133421a2b0 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.253591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0521e2-3e75-4033-9dd1-33133421a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.254050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0521e2-3e75-4033-9dd1-33133421a2b0 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.256412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 34/66] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:02.259403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 33/67] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.265325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.265325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.265325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.266582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.285513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367cd8c-0011-4341-9937-8cb1535a85f4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.290131 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:02.290281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.291027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.291317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.292073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:02.292175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.293393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.295222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.301334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 35/68] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:02.301577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.302234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.303462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.313871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7840d79-c5f7-462e-a19c-e51df91abc1c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.318420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.319050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.319341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.319637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.325951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb6a153-582f-4220-9e59-c19a7a474067 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.327865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.329660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.342788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 35/70] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:02.343337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.343609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.344324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.344613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.344893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.354849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364be42-c0c4-4f12-9579-e0519d5c06ff admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.357232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:02.359478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.360305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.360591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.360870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.364383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:02.365866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 36/71] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:02.366661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.377794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745743e1-4256-411f-82b3-c312f069cee3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.378915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:02.382908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.384048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.384564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.385023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.386244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:02.386700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.387792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 36/72] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:02.393896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.395093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.397564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 37/73] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.398589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.403645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d7a36-4475-4832-8496-f23dda8f252f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.403892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.404561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.404851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.405128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.405907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:02.406218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.407887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.418316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee050353-689c-4fce-b329-0a71ca5c3a85 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.423781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 37/74] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.424594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.424895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.425830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.426382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.426885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.427975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:02.428553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.430624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.438622 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808d7d-5bf2-43ee-b53e-97e88ec0c84c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.442403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 38/75] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.447761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.447761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.447761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.447761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.448145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8, user.id=dce917494d344377a020b14e93b0e3e7) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:02.448145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.448145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:02.448145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:02.448145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:02.450083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.451145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.457932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 38/76] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/role_assignments?user.id=dce917494d344377a020b14e93b0e3e7&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.459374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.463331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff568f-39e2-4def-a760-3e36e675b4c7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.468669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.469965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.470431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c5da-5d04-4443-8194-ab6fab6980c7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.470660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.471215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.476439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.477332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.477614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.477892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.493568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.496840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.499664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 39/77] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.511649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.511649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.511649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 39/78] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.512295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.518801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.533802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52af170-b5cc-4fdf-83ec-a7099946718a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.536940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d4046-ba83-4d77-b216-d570a5a20460 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.544789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.545735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.546024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.546310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.548510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a402b-0a8d-403c-bf7e-24a411a70544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.549180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a402b-0a8d-403c-bf7e-24a411a70544 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.549467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a402b-0a8d-403c-bf7e-24a411a70544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.549748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a402b-0a8d-403c-bf7e-24a411a70544 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.566787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.568194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.573658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a402b-0a8d-403c-bf7e-24a411a70544 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.575488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a402b-0a8d-403c-bf7e-24a411a70544 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.590450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 40/79] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:02.592372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 40/80] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:02.595613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb705-acae-47c3-b625-c2df271bdb1b None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.595876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb705-acae-47c3-b625-c2df271bdb1b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.596162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6cb705-acae-47c3-b625-c2df271bdb1b None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.597976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 41/81] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:02.599887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.605148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb705-acae-47c3-b625-c2df271bdb1b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.610751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fb538-483b-4e7b-a64c-e083ac917417 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.616674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bae6eb-e6e8-4f25-9280-00a81a96fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.617556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae6eb-e6e8-4f25-9280-00a81a96fd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.617671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6cb705-acae-47c3-b625-c2df271bdb1b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.617871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae6eb-e6e8-4f25-9280-00a81a96fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.618126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bae6eb-e6e8-4f25-9280-00a81a96fd9a admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.619568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae6eb-e6e8-4f25-9280-00a81a96fd9a admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.621905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bae6eb-e6e8-4f25-9280-00a81a96fd9a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.622300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.623174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.623468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.623851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.624015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 41/82] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.625437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.625735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.626020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.630406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.633410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.637242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 42/83] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.638471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.647295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:02.648571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:02.648928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8be505-950a-460f-80cd-d3b89c962e72 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.654121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.654808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.655101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.655388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.656310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] RBAC: Adding query filter params (role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8, user.id=d6e04acab92947cbb4ee9ad021c576a2) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:02.656630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.657625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 42/84] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:02.658562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.658728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.669723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b03f2-e791-44f1-8ce2-e86279417e63 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.676998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 43/85] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/role_assignments?user.id=d6e04acab92947cbb4ee9ad021c576a2&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=304db4839fd8407ea7f2e75407363716 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.678764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.679457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.679788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.680072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.680957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] RBAC: Adding query filter params (role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8, user.id=d6e04acab92947cbb4ee9ad021c576a2) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:02.681276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.683333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.689248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.694005 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 43/86] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/role_assignments?user.id=d6e04acab92947cbb4ee9ad021c576a2&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:02.699927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12029-3609-45b2-a68d-d400730cb8b4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.708345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cecdd4-bf04-42a6-861e-75bfdd7be8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.709212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cecdd4-bf04-42a6-861e-75bfdd7be8ff admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.709503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cecdd4-bf04-42a6-861e-75bfdd7be8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.709788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cecdd4-bf04-42a6-861e-75bfdd7be8ff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.711270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cecdd4-bf04-42a6-861e-75bfdd7be8ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.713139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cecdd4-bf04-42a6-861e-75bfdd7be8ff admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.715920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 44/87] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:02.722214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:02.737545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a138-5edb-42bc-95a9-62877a22f8bd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:02.748414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e689-77fd-4947-bc6f-68baf33385d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:02.749118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e689-77fd-4947-bc6f-68baf33385d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.749409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e689-77fd-4947-bc6f-68baf33385d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.749694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e689-77fd-4947-bc6f-68baf33385d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.750484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e689-77fd-4947-bc6f-68baf33385d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:02.752627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e689-77fd-4947-bc6f-68baf33385d0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:02.793278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 44/88] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:44:02 2021] POST /identity/v3/projects => generated 302 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:02.933608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625f8a-feef-4ebe-9cbd-d1b5271485f9 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.933964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625f8a-feef-4ebe-9cbd-d1b5271485f9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.934174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625f8a-feef-4ebe-9cbd-d1b5271485f9 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.936341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 45/89] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:02.943956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:02.944302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:02.944536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:02.975859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:02.977094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:03.045203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 45/90] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:03.070834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625f8a-feef-4ebe-9cbd-d1b5271485f9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:03.083895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625f8a-feef-4ebe-9cbd-d1b5271485f9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:03.088985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:03.089793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:03.090086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:03.090373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:03.101449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:03.108393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:03.109908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 46/91] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:03.121016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:03.131712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666185a-c395-48f7-8843-220bd7ff6b59 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:03.138522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:03.139501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:03.140051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:03.140541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:03.141623 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:03.142146 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:03.144202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:03.156361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 46/92] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:03.162866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:03.178272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbfeba-2b28-465b-9b1e-d88313ed1964 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:03.184929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:03.185752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:03.186045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:03.186329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:03.188235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:03.190431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:03.192402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 47/93] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:03 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:03.199148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:03.211789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa72f3-3787-4e78-8ee0-e64ae582e070 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:03.220363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:03.221374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:03.221942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:03.222490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:03.234946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:03.237267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:03.249946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 47/94] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:03 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:03.256242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:03.267886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa81c1-f505-4fcb-a24c-a79ec11aa281 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:03.273270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbc9e28-d583-4651-8f38-2b48dee35cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:03.274134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9e28-d583-4651-8f38-2b48dee35cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:03.274426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9e28-d583-4651-8f38-2b48dee35cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:03.274714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbc9e28-d583-4651-8f38-2b48dee35cf2 admin admin] PATH_INFO: `/v3/projects/b0a79647a31548759709022dbdbab0e0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:03.276526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc9e28-d583-4651-8f38-2b48dee35cf2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b0a79647a31548759709022dbdbab0e0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:03.278620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbc9e28-d583-4651-8f38-2b48dee35cf2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:03.283187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 48/95] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:03 2021] GET /identity/v3/projects/b0a79647a31548759709022dbdbab0e0 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:03.289187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:03.299253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98683739-773a-4c03-b09a-9800491f5d69 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:03.304888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:03.305601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:03.305944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:03.306226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:03.307228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] RBAC: Adding query filter params (role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=b0a79647a31548759709022dbdbab0e0, user.id=d6e04acab92947cbb4ee9ad021c576a2) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:03.307554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:03.309497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d08e7-576c-4a76-8f1a-2a3e1f26977e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:03.317037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 48/96] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:03 2021] GET /identity/v3/role_assignments?user.id=d6e04acab92947cbb4ee9ad021c576a2&scope.project.id=b0a79647a31548759709022dbdbab0e0&role.id=304db4839fd8407ea7f2e75407363716 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:05.467786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d553-e1b4-4e64-b723-c8406ab7bb82 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.468324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d553-e1b4-4e64-b723-c8406ab7bb82 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.468324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277d553-e1b4-4e64-b723-c8406ab7bb82 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.470363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 49/97] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:05.476558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.477024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.477203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.485975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef73ed-8f46-4e69-b91d-07318789ec86 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.486279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef73ed-8f46-4e69-b91d-07318789ec86 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.486566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef73ed-8f46-4e69-b91d-07318789ec86 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.488346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 50/98] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:05.503296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:05.504157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.504522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.504623 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:05.504872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.512692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 49/99] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:05.537026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:05.538544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:05.542297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.553052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c1538-1d5a-4155-8c0d-494846f9fc9b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.553392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 51/100] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:05.566931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.567777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.568072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.568360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.584420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:05.592207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:05.593744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 50/101] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:05.600116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.601424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.618870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316d551-f1f7-4bda-aa95-73ae5e93e397 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.621352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084b5f3-b4c3-437d-9918-44a20bfbeb02 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.628540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.629337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.629634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.629920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.630912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.631574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.631887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.632169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.632953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:05.633273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.634883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.653541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:05.659583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 52/102] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:05.662602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:05.663946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 51/103] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:05.670280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.678693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.683180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be9dec-300f-4a65-8142-d0f291856ca8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.693703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f86b1-8cc9-4e96-8ca6-9c21aa0a5e38 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.697754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.698448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.698739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.699028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.699837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:05.700156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.701784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.710869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b094d-a6c8-42f9-9569-6b9337317e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.711953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b094d-a6c8-42f9-9569-6b9337317e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.712252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b094d-a6c8-42f9-9569-6b9337317e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.712536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b094d-a6c8-42f9-9569-6b9337317e30 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.714642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b094d-a6c8-42f9-9569-6b9337317e30 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.717034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b094d-a6c8-42f9-9569-6b9337317e30 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.717514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 53/104] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:05.718942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 52/105] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:05.725268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.726382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe559-e513-4f37-aa5d-18fd8ccce4e8 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.727077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe559-e513-4f37-aa5d-18fd8ccce4e8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.727574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fe559-e513-4f37-aa5d-18fd8ccce4e8 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.730380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 53/106] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:05.731311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fe559-e513-4f37-aa5d-18fd8ccce4e8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.741176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ae922-4658-4d2d-8697-e7ed11c70626 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.745919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fe559-e513-4f37-aa5d-18fd8ccce4e8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.746443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03e483-b692-4373-9b60-cbaaeb4a1cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.747542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03e483-b692-4373-9b60-cbaaeb4a1cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.747918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03e483-b692-4373-9b60-cbaaeb4a1cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.748243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03e483-b692-4373-9b60-cbaaeb4a1cf5 admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.749624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03e483-b692-4373-9b60-cbaaeb4a1cf5 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.751736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.751871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03e483-b692-4373-9b60-cbaaeb4a1cf5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.752928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.753432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.753838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 54/107] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:05.754322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.754890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.755226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.759720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.760676 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.764726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.766873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 54/108] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:05.771642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.780248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:05.781258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:05.784102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751606c-52a8-4b6b-8315-1e51d220eeaf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.788685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.789706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.790155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.790581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.790891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 55/109] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:05.792310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.794706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.797149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 55/110] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:05.805134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.809513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.813657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c7478-5377-480e-b554-213c7df8a8ad None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.818574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.819610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.819975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.820305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/users/d6e04acab92947cbb4ee9ad021c576a2/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.822615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c32f041464e76b60eaf53f01b9ee8, user_id=d6e04acab92947cbb4ee9ad021c576a2, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.827656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:05.827656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:05.827656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:05.827656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.829420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8bad9-6952-481d-a159-475ab7c16372 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:05.839033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:05.840264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:05.840771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:05.841254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/users/dce917494d344377a020b14e93b0e3e7/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:05.843509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c32f041464e76b60eaf53f01b9ee8, user_id=dce917494d344377a020b14e93b0e3e7, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:05.844278 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 56/111] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:05 2021] PUT /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/users/d6e04acab92947cbb4ee9ad021c576a2/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:05.845171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:05.847392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:05.887702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 56/112] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:05 2021] PUT /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/users/dce917494d344377a020b14e93b0e3e7/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:44:05.950614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfe82-de13-42b2-bdca-2f01b0cba74a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.041627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c7f74-8bdc-4202-920e-1f0f0304e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.042385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c7f74-8bdc-4202-920e-1f0f0304e6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.042672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c7f74-8bdc-4202-920e-1f0f0304e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.042950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c7f74-8bdc-4202-920e-1f0f0304e6e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.060016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c7f74-8bdc-4202-920e-1f0f0304e6e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:06.068563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f36c7f74-8bdc-4202-920e-1f0f0304e6e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:06.070597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 57/113] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:06.078051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.098942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259462-c50c-4c30-867b-cec2c6ac390e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.107740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.108447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.108741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.109023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.109828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:06.110144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.111888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.121831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d1a26-f97c-4218-a13f-9ac79df139bb None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.122130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d1a26-f97c-4218-a13f-9ac79df139bb None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.123762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d1a26-f97c-4218-a13f-9ac79df139bb None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.124537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 58/114] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:06.129533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 57/115] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:06.134816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.135165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.135485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.137289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.149514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a043e44-5d76-4b73-93ac-7e3c321de11e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.159484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.161022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.161513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.162073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.162175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:06.163765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:06.164024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.167267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.169439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 58/116] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:06.175974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.189072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541a05d-a5fd-4d54-91a7-b1526d0ba7cf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.190768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 59/117] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:06.198752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.200212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.200831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.201432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.203195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.205794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.207954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 59/118] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:06.214129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.224015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5c3b3-1f5f-4160-ae87-7abb3bb11e91 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.228566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.230003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.230299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.230585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/users/d6e04acab92947cbb4ee9ad021c576a2/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.232985 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.239878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c32f041464e76b60eaf53f01b9ee8, user_id=d6e04acab92947cbb4ee9ad021c576a2, role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.239878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.246006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b346978-7846-4db2-b51e-382185ede361 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.252270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9064c2e0-d026-42f8-a70a-404cc454093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.253337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c2e0-d026-42f8-a70a-404cc454093f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.253806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c2e0-d026-42f8-a70a-404cc454093f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.254298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9064c2e0-d026-42f8-a70a-404cc454093f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.255702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064c2e0-d026-42f8-a70a-404cc454093f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.257657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9064c2e0-d026-42f8-a70a-404cc454093f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.258888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 60/119] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:06 2021] PUT /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/users/d6e04acab92947cbb4ee9ad021c576a2/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:06.259657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 60/120] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:06.266486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.345196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c2be0-9575-4c66-ab2b-6b665c768efd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.350134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dadb15-5f08-43c2-839f-a4ffaf6879d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.351002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dadb15-5f08-43c2-839f-a4ffaf6879d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.351340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dadb15-5f08-43c2-839f-a4ffaf6879d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.351678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dadb15-5f08-43c2-839f-a4ffaf6879d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.352460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dadb15-5f08-43c2-839f-a4ffaf6879d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.355171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dadb15-5f08-43c2-839f-a4ffaf6879d1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.381437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 61/121] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:06 2021] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:06.628310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b042c0-d0bc-469c-8663-e118b2a557af None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.629279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b042c0-d0bc-469c-8663-e118b2a557af None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.629804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b042c0-d0bc-469c-8663-e118b2a557af None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.631909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 61/122] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:06.638612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64428-6810-4852-82d5-97a15981b833 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.639095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64428-6810-4852-82d5-97a15981b833 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.639301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f64428-6810-4852-82d5-97a15981b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.664466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-23f64428-6810-4852-82d5-97a15981b833 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:06.665928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-23f64428-6810-4852-82d5-97a15981b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:06.678884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 62/123] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:06.713999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b042c0-d0bc-469c-8663-e118b2a557af None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.732975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b042c0-d0bc-469c-8663-e118b2a557af None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.737803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.738838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.739328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.739851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.755991 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:06.763288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:06.764763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 62/124] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:06.774324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64428-6810-4852-82d5-97a15981b833 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.786053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f64428-6810-4852-82d5-97a15981b833 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.790817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.792074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.792368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.792655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.793486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:06.793808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.795790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.804842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 63/125] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:06.811606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.822042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecad5b5-66bf-4a77-b665-3d1ac39d4662 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.826868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.827857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.828202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.828487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.829736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.833360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.835329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 63/126] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:06.841326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.851871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127050c3-9c3b-48b1-817f-fdadc72ac12a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.857147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1c654-b8e8-4ca2-b34f-5e50444e8ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.858073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1c654-b8e8-4ca2-b34f-5e50444e8ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.858368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1c654-b8e8-4ca2-b34f-5e50444e8ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.858654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1c654-b8e8-4ca2-b34f-5e50444e8ef1 admin admin] PATH_INFO: `/v3/projects/b0a79647a31548759709022dbdbab0e0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.859961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1c654-b8e8-4ca2-b34f-5e50444e8ef1 admin admin] RBAC: Authorizing `identity:get_project(project_id=b0a79647a31548759709022dbdbab0e0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.862244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1c654-b8e8-4ca2-b34f-5e50444e8ef1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.864291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 64/127] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:06 2021] GET /identity/v3/projects/b0a79647a31548759709022dbdbab0e0 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:06.871199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:06.881679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e14d75-8100-46a4-bf08-44abe6079343 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:06.892215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251702f6-ff0a-4f98-81a2-2a1b5484171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:06.893199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251702f6-ff0a-4f98-81a2-2a1b5484171e admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:06.893484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251702f6-ff0a-4f98-81a2-2a1b5484171e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:06.893857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251702f6-ff0a-4f98-81a2-2a1b5484171e admin admin] PATH_INFO: `/v3/projects/b0a79647a31548759709022dbdbab0e0/users/d6e04acab92947cbb4ee9ad021c576a2/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:06.896230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251702f6-ff0a-4f98-81a2-2a1b5484171e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a79647a31548759709022dbdbab0e0, user_id=d6e04acab92947cbb4ee9ad021c576a2, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:06.900530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251702f6-ff0a-4f98-81a2-2a1b5484171e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:06.918620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 64/128] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:06 2021] PUT /identity/v3/projects/b0a79647a31548759709022dbdbab0e0/users/d6e04acab92947cbb4ee9ad021c576a2/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:08.728280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047e99e-3166-4940-9a8f-69301c2f2eeb None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:08.729458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047e99e-3166-4940-9a8f-69301c2f2eeb None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:08.729458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047e99e-3166-4940-9a8f-69301c2f2eeb None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:08.731358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 65/129] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:08.739908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:08.740424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:08.740502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:08.762088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:08.763314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:08.829646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 65/130] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:08.881319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047e99e-3166-4940-9a8f-69301c2f2eeb None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:08.893949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047e99e-3166-4940-9a8f-69301c2f2eeb None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:08.898497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240fed5-fe75-42b3-8a96-58c0e4b9b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:08.899294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240fed5-fe75-42b3-8a96-58c0e4b9b195 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:08.899585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240fed5-fe75-42b3-8a96-58c0e4b9b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:08.899890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240fed5-fe75-42b3-8a96-58c0e4b9b195 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:08.911338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a240fed5-fe75-42b3-8a96-58c0e4b9b195 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:08.918783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a240fed5-fe75-42b3-8a96-58c0e4b9b195 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:08.920213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 66/131] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:08.927529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:08.936773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd12e1-9e1d-470b-80cf-df1994983820 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:08.939774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aef41-d483-4f62-8f27-5c0319d74df5 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:08.940069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aef41-d483-4f62-8f27-5c0319d74df5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:08.940353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aef41-d483-4f62-8f27-5c0319d74df5 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:08.942145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 67/132] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:08.945512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:08.946194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:08.946484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:08.946772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:08.948119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:08.948447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:08.950088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:08.956296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:08.956593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:08.956885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:08.976290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 66/133] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:08.983132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:08.983881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:08.985092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:08.999900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee25c07-a6a6-411c-92e1-53a5464492ad admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.007460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 68/134] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:08 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:09.008833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.009633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.010433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.010740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.016408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.018275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.019956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 67/135] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:08 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:09.027425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.040796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c47a3-62b7-495b-807c-5f6583fc65d7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.045764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.046426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.046725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.047013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.059857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.061662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.068789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.080839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a5809-bf3a-426c-a8a3-2f8e27b842db admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.086303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 69/136] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:09.094570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.099773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.100588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.100879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.101164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.116278 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc147d61-14bf-4800-8ea6-b7384bb019da admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.123546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:09.129143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.130012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.130302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.130641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.132333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.134433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.141414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 70/137] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:09.142922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:09.144292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 68/138] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:09.153045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.155310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.168912 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bf9d1-eeb4-401c-8194-8852f42fc512 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.169695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89da6d9-7ae1-4389-9992-ea7ce7e45df8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.178848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.179695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.180019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.180433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.181226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:09.181572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.183373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.184854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.185783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.186075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.186355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.187525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8, user.id=dce917494d344377a020b14e93b0e3e7) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:09.187968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.190930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.200183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 69/139] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:09.205126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 71/140] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/role_assignments?user.id=dce917494d344377a020b14e93b0e3e7&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:09.214318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.231502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe1c4f-0b07-4c6e-b338-1ca1cbb1178e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.239857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.240823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.241112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.241394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.245609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.247952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.249788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 70/141] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:09.256881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.273713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4717d-8a5b-496d-9910-8df709da893d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.284819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.285602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.285962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.286332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.302314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.304677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.323151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 72/142] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:09.329900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.344471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0c663-c4ca-4438-962c-25b402c0b6f7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.352472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa0a7-c7cf-4927-86ed-38a8ce09ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.353408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa0a7-c7cf-4927-86ed-38a8ce09ab34 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.353724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa0a7-c7cf-4927-86ed-38a8ce09ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.354016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa0a7-c7cf-4927-86ed-38a8ce09ab34 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.358683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa0a7-c7cf-4927-86ed-38a8ce09ab34 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.361016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa0a7-c7cf-4927-86ed-38a8ce09ab34 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.363023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 71/143] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:09.370682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:09.386282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d2b1-4f73-40aa-bc17-44d4ed783fde admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:09.396592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:09.397501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.397888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.398210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.399137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] RBAC: Adding query filter params (role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8, user.id=d6e04acab92947cbb4ee9ad021c576a2) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:09.399455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:09.402088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0009837-5e69-4cbb-9062-d15054efae75 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:09.412639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 73/144] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:09 2021] GET /identity/v3/role_assignments?user.id=d6e04acab92947cbb4ee9ad021c576a2&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=304db4839fd8407ea7f2e75407363716 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:09.996139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b892b-a0c4-47b3-a306-76f37d88a207 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:09.996716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b892b-a0c4-47b3-a306-76f37d88a207 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:09.996716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b892b-a0c4-47b3-a306-76f37d88a207 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:09.998711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 72/145] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:10.004849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.005324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.005454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.028905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:10.030099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:10.041819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 74/146] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:10.080618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b892b-a0c4-47b3-a306-76f37d88a207 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.096438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b892b-a0c4-47b3-a306-76f37d88a207 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.107064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.107966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.108264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.108551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.128581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:10.136640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:10.138759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 73/147] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:10.145299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.156611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724449e0-e35c-4682-9d13-a6c72e99c515 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.163547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.164281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.164567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.164848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.165628 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:10.165939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.168311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.183479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 75/148] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:10.189875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.202900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab0597-0012-454c-9e0f-9d9dbeb02153 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.209820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.210814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.211109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.211391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.212939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.215816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.217665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 74/149] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:10.223975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.236632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8bf29-67b8-46fa-aa92-f368eb70b0b0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.243470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.244154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.244480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.244763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.256725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.258423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.273313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 76/150] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:10.281552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.295246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e2015-f2c8-4003-b541-d75fe5d50a42 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.303885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fa5bf-3ff2-4760-9f86-c976e0e7b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.304764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fa5bf-3ff2-4760-9f86-c976e0e7b15b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.305049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fa5bf-3ff2-4760-9f86-c976e0e7b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.305331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fa5bf-3ff2-4760-9f86-c976e0e7b15b admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.312504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fa5bf-3ff2-4760-9f86-c976e0e7b15b admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.314619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fa5bf-3ff2-4760-9f86-c976e0e7b15b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.316417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 75/151] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:10.323199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.336812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c4cf6-743f-4cc5-bb0d-a1fed0d3a98b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.347537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.348236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.348525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.348813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.349680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] RBAC: Adding query filter params (role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8, user.id=d6e04acab92947cbb4ee9ad021c576a2) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:10.349996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.351884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52243b-7145-4d38-943f-848f45f3b92f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.364153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 77/152] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/role_assignments?user.id=d6e04acab92947cbb4ee9ad021c576a2&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:10.753685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b80e23-374a-444c-ade6-40e3c5f5d301 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.754047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b80e23-374a-444c-ade6-40e3c5f5d301 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.754271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b80e23-374a-444c-ade6-40e3c5f5d301 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.756400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 76/153] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:10.762970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.763266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.763557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.788764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:10.790002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:10.801571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 78/154] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:10.850118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b80e23-374a-444c-ade6-40e3c5f5d301 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.865731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b80e23-374a-444c-ade6-40e3c5f5d301 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.873914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.874741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.875032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.875314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.893895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:10.901644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:10.902915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 77/155] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:10.909598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.918959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad0359-e379-46f6-a2af-67777620bbf7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.927697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.928383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.928678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.928966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.929751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:10.930064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.931720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.948381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 79/156] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:10.954552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:10.968786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7b5d-6696-4068-b97a-ec2fd80452fd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:10.976455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1cf94-9bea-46a4-9f0f-719fe71f7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:10.977367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1cf94-9bea-46a4-9f0f-719fe71f7e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:10.977654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1cf94-9bea-46a4-9f0f-719fe71f7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:10.977937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1cf94-9bea-46a4-9f0f-719fe71f7e3a admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:10.979346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1cf94-9bea-46a4-9f0f-719fe71f7e3a admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:10.981609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1cf94-9bea-46a4-9f0f-719fe71f7e3a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:10.983356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 78/157] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:10.989840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.004627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209967c-465a-4bb7-8a1f-debee7190226 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.012773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.013454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.013718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.014004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.024199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.025666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.037302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7957dc-c827-4818-8059-e694650acd08 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.037901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7957dc-c827-4818-8059-e694650acd08 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.037901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7957dc-c827-4818-8059-e694650acd08 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.039805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 79/158] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:11.046050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.046338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.046681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.054649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 80/159] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:11.067384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.076881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:11.078058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:11.082279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec20029-e93a-41a3-80ab-7fc54dc89277 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.089044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.089912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.090202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.090482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] PATH_INFO: `/v3/projects/b0a79647a31548759709022dbdbab0e0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.091847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] RBAC: Authorizing `identity:get_project(project_id=b0a79647a31548759709022dbdbab0e0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.093934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.095801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 81/160] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/projects/b0a79647a31548759709022dbdbab0e0 => generated 312 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:11.103258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 80/161] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:11.106484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.117957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c0521-affc-4201-9b8b-c60594e88a10 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.125126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.125801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.126091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.126375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.127239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] RBAC: Adding query filter params (role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=b0a79647a31548759709022dbdbab0e0, user.id=d6e04acab92947cbb4ee9ad021c576a2) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:11.127561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.129521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.136569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 82/162] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/role_assignments?user.id=d6e04acab92947cbb4ee9ad021c576a2&scope.project.id=b0a79647a31548759709022dbdbab0e0&role.id=304db4839fd8407ea7f2e75407363716 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.154719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.169267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a4b85-98fe-472d-9d05-86d8c2c3bc94 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.174262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.175086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.175375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.175693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.190072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:11.197052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:11.199138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 81/163] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:11.205520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.215791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ed6e-939a-4cb4-9cde-ce59f4ad373e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.222661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.223352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.223718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.224012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.224797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:11.225162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.226847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.237427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 83/164] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.243793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.254915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6df133-0da7-4911-8b50-71ce0331578e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.262372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.263315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.263602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.263909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.282142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.284508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.286339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 82/165] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:11.293564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.304553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6511bdd-55a6-411a-a005-0b0f227176e1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.309472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.310137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.310474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.310764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.319805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.321660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.332298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 84/166] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:11.340820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.351166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93b6c4-8f0a-4141-b969-131717d79774 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.359113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1591589-ee66-48db-9162-667fb0f05de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.360001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1591589-ee66-48db-9162-667fb0f05de9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.360348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1591589-ee66-48db-9162-667fb0f05de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.360633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1591589-ee66-48db-9162-667fb0f05de9 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.364609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1591589-ee66-48db-9162-667fb0f05de9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.366926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1591589-ee66-48db-9162-667fb0f05de9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.369138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 83/167] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.376053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.386399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321962a1-fe34-4c5d-8c90-137ba43fc29a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.396395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.397085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.397431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.397719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.398657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] RBAC: Adding query filter params (role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216, user.id=94381fecb7f9488eba1dfafeca14fab5) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:11.398981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.401145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850b86-7983-40be-af4d-1851c13c2e76 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.407663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 85/168] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/role_assignments?user.id=94381fecb7f9488eba1dfafeca14fab5&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=304db4839fd8407ea7f2e75407363716 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.636948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c6e03-1e78-4527-b4f3-78537cca1117 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.637309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c6e03-1e78-4527-b4f3-78537cca1117 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.637599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c6e03-1e78-4527-b4f3-78537cca1117 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.639497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 84/169] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:11.646010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.646304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.646569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.669211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:11.670664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:11.683045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 86/170] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:11.707547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c6e03-1e78-4527-b4f3-78537cca1117 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.722784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c6e03-1e78-4527-b4f3-78537cca1117 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.727417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.728290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.728575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.728937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.742883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:11.750705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:11.751956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 85/171] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:11.758360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.770596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d864-2b6b-4c5c-a47e-92404bb84fde None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.778647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.779580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.780096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.780569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.781564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:11.782067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.783953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.796337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 87/172] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.802627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.813626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fde45-da40-4211-bcc0-8f5cfb83499e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.818174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.819074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.819357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.819667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.821001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.823473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.825471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 86/173] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.831406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.842440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49beb69-4815-405d-adf4-de2bbe62ba6f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.847426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.848669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.849267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.849862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.859324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.861359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.872573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 88/174] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:11.879022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.895385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adf0a1-c0ab-4fe3-8af4-40de814b6c0d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.900189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b541a-7774-49b8-b3c8-cc3fd00cbfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.901299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b541a-7774-49b8-b3c8-cc3fd00cbfdb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.901797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b541a-7774-49b8-b3c8-cc3fd00cbfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.902242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b541a-7774-49b8-b3c8-cc3fd00cbfdb admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.903687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b541a-7774-49b8-b3c8-cc3fd00cbfdb admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.906151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b541a-7774-49b8-b3c8-cc3fd00cbfdb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.908204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 87/175] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:11.916874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:11.926475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efafb2-4593-4585-8dc7-961dc41d3164 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:11.931056 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:11.932260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:11.932603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:11.932886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:11.933847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216, user.id=dce917494d344377a020b14e93b0e3e7) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:11.934168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:11.936166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88591-1e14-475d-9281-f447582ea61d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:11.942382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 89/176] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:11 2021] GET /identity/v3/role_assignments?user.id=dce917494d344377a020b14e93b0e3e7&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:12.017969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bac3-d8d4-4a6c-8939-73e9a04f20cf None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.018618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bac3-d8d4-4a6c-8939-73e9a04f20cf None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.019093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8bac3-d8d4-4a6c-8939-73e9a04f20cf None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.021380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 88/177] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:12.028458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.029459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.029939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.049809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:12.051375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:12.060256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 90/178] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:12.085787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8bac3-d8d4-4a6c-8939-73e9a04f20cf None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.099951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8bac3-d8d4-4a6c-8939-73e9a04f20cf None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.105860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf8253-f5a1-4cab-935f-4e62cbff9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.107223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf8253-f5a1-4cab-935f-4e62cbff9e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.107804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf8253-f5a1-4cab-935f-4e62cbff9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.108329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf8253-f5a1-4cab-935f-4e62cbff9e87 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.121534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf8253-f5a1-4cab-935f-4e62cbff9e87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:12.129604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-d3cf8253-f5a1-4cab-935f-4e62cbff9e87 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:12.131310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 89/179] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:12.138260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.145240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d9496-8ef5-4c1d-96d3-db4965e25be0 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.145582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d9496-8ef5-4c1d-96d3-db4965e25be0 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.145821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d9496-8ef5-4c1d-96d3-db4965e25be0 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.147869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 90/180] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:12.149160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29409de5-a35b-4bdf-a670-b8ca9b96426d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.156845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.156999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.157184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.157428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.158245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.158806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.159287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.160522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:12.161142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.163312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.173420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 91/181] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:12.179595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:12.179960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.180899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:12.194368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742c60f-8d8d-46a4-8ce8-d4a7737680f7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.196928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 91/182] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:12.202302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.203552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.204125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.204637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.206204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.208834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.215750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 92/183] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:12.217353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.219959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.229504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604f978-9187-406a-b7ff-6d8e27bc4e0f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.229761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16102-6a28-4b93-9f7f-fbb5aac8f9eb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.234207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.235040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.235355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.235667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.236082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.236956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.237245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.237716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.238183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.238758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.240545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 93/184] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:12.246739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.247882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.249842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.258077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f941d1-767d-415d-8f2a-eab168ef2dfc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.261171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 92/185] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:12.266960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.267769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.267969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.268126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.268547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] PATH_INFO: `/v3/groups` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.269328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.270445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:12.270445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:12.270445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:12.271858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.279589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f4291-dfe1-4eeb-b4b2-e65d16c03def admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.284837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a7530-b20c-45b5-87e6-16c401fca0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.285518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a7530-b20c-45b5-87e6-16c401fca0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.285803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a7530-b20c-45b5-87e6-16c401fca0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.286080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a7530-b20c-45b5-87e6-16c401fca0d6 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.287274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a7530-b20c-45b5-87e6-16c401fca0d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.289363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a7530-b20c-45b5-87e6-16c401fca0d6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.290747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 94/186] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 9 04:44:12 2021] POST /identity/v3/groups => generated 229 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:12.295747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 93/187] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:12.298398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:12.309734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0074fa-1028-463f-8c4f-592070555421 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:12.315116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:12.316271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:12.316754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:12.317273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:12.318413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] RBAC: Adding query filter params (role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216, user.id=94381fecb7f9488eba1dfafeca14fab5) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:12.318963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:12.321222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0093d14-c96e-45f1-98de-4b0187f7d14e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:12.329234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 95/188] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:12 2021] GET /identity/v3/role_assignments?user.id=94381fecb7f9488eba1dfafeca14fab5&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:13.772144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867d5d-c938-418b-915e-9d6698d3e44f None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.772648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867d5d-c938-418b-915e-9d6698d3e44f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.772718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c867d5d-c938-418b-915e-9d6698d3e44f None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.774757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 94/189] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:13.781393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626415-4275-478b-97f9-824a79bd451b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.781797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626415-4275-478b-97f9-824a79bd451b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.781981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37626415-4275-478b-97f9-824a79bd451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.799944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-37626415-4275-478b-97f9-824a79bd451b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:13.801130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-37626415-4275-478b-97f9-824a79bd451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:13.808700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 96/190] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:13.832348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c867d5d-c938-418b-915e-9d6698d3e44f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:13.845042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c867d5d-c938-418b-915e-9d6698d3e44f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:13.849407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:13.850254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.850604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.850947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.861433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:13.868334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:13.870080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 95/191] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:13.876556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626415-4275-478b-97f9-824a79bd451b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:13.886090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37626415-4275-478b-97f9-824a79bd451b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:13.890607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:13.891341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.891725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.892075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.892917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:13.893298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:13.894968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:13.903410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 97/192] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:13.910000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:13.920850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7def1-5da6-425f-913c-60418516637f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:13.925324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:13.926250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.926604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.926949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.928250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:13.930441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:13.932815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 96/193] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:13 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:13.938876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:13.949191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55814618-3e73-4f03-9bb4-098fab8f1f9a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:13.953595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f0a96-4e2b-4a23-8774-7265865e70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:13.954515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0a96-4e2b-4a23-8774-7265865e70d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.954874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0a96-4e2b-4a23-8774-7265865e70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.955224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f0a96-4e2b-4a23-8774-7265865e70d0 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.956530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0a96-4e2b-4a23-8774-7265865e70d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:13.958663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f0a96-4e2b-4a23-8774-7265865e70d0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:13.960422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 98/194] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:13 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:13.966651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:13.976450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd27f62-ffbb-4a7b-9501-50fe1868b884 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:13.980881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31ff45-3b4e-4148-b1f0-510533838367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:13.981826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31ff45-3b4e-4148-b1f0-510533838367 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:13.982181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31ff45-3b4e-4148-b1f0-510533838367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:13.982529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31ff45-3b4e-4148-b1f0-510533838367 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/users/94381fecb7f9488eba1dfafeca14fab5/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:13.984579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31ff45-3b4e-4148-b1f0-510533838367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4e57e4b88f46b79e1ba71e17c1c216, user_id=94381fecb7f9488eba1dfafeca14fab5, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:13.987285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31ff45-3b4e-4148-b1f0-510533838367 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.002048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 97/195] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:13 2021] PUT /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/users/94381fecb7f9488eba1dfafeca14fab5/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:44:14.246797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec150a-7a76-4fb2-a57f-8d8e7104e5ff None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.247083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec150a-7a76-4fb2-a57f-8d8e7104e5ff None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.247364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec150a-7a76-4fb2-a57f-8d8e7104e5ff None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.249398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 99/196] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:14.255577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.255978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.256282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.274797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:14.276050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:14.335591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 98/197] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:14.359314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec150a-7a76-4fb2-a57f-8d8e7104e5ff None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.372271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec150a-7a76-4fb2-a57f-8d8e7104e5ff None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.376951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.377742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.378023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.378297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.388646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:14.395440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:14.396658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 100/198] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:14.403225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.412385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38613490-a699-4b47-b5c3-8e66b5987a2b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.417345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.418003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.418287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.418563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.419332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:14.419709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.421520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.430368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 99/199] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:14.437288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.447700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b188de-062b-47de-a697-41304f4fd3aa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.452287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.453141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.453427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.453706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.454907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.456881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.458475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 101/200] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:14.464719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.474713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd3c9c-26c1-458a-a1e2-8856bb5eb233 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.479948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ba67e-ac72-44db-aaa8-ba1ea02e3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.480797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba67e-ac72-44db-aaa8-ba1ea02e3f5a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.481136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba67e-ac72-44db-aaa8-ba1ea02e3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.481415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ba67e-ac72-44db-aaa8-ba1ea02e3f5a admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.482658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ba67e-ac72-44db-aaa8-ba1ea02e3f5a admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.484796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ba67e-ac72-44db-aaa8-ba1ea02e3f5a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.486620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 100/201] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:14.493181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.504620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942323d-92eb-4130-9dec-b5aa3915bf25 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.509566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590e3d8-2fa5-4594-8f8f-644edb478902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.510590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e3d8-2fa5-4594-8f8f-644edb478902 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.510876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e3d8-2fa5-4594-8f8f-644edb478902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.511195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590e3d8-2fa5-4594-8f8f-644edb478902 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/users/dce917494d344377a020b14e93b0e3e7/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.513695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590e3d8-2fa5-4594-8f8f-644edb478902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4e57e4b88f46b79e1ba71e17c1c216, user_id=dce917494d344377a020b14e93b0e3e7, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.516769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590e3d8-2fa5-4594-8f8f-644edb478902 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.539850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 102/202] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:14 2021] PUT /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/users/dce917494d344377a020b14e93b0e3e7/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:14.661970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8ec5-bc09-42e5-a805-b02ab4ee9e9d None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.662285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8ec5-bc09-42e5-a805-b02ab4ee9e9d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.662591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f8ec5-bc09-42e5-a805-b02ab4ee9e9d None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.664557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 101/203] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:14.670865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343fef-fe62-4d9b-beba-59df7446e9d4 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.671176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343fef-fe62-4d9b-beba-59df7446e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.671429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3343fef-fe62-4d9b-beba-59df7446e9d4 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.673301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.673589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.673681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 103/204] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:14.674109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.687405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.688103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.688580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.696615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:14.698365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:14.712737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:14.714923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:14.761911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 102/205] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:14.785658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.786495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 104/206] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:14.795197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbe70b-b0b7-40d6-9b8e-3efbd992aea4 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.799891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.800676 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.800956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.801228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.802392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.804108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.805968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 103/207] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:14.812615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.816694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.821950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549f5b6-5ff0-4968-8d8b-600ae39b23d1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.826510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.827182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.827493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.827803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] PATH_INFO: `/v3/groups` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.828479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.830395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.831420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798b815-8831-4868-98c1-363790e40a53 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.836984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.839006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.839589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.840171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.847674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 105/208] 10.222.0.41 () {60 vars in 1155 bytes} [Tue Nov 9 04:44:14 2021] POST /identity/v3/groups => generated 226 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:14.856868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:14.865092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:14.866676 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 104/209] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:14.874514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.886864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6a4f-4eb9-4326-8a60-f578eb884aad admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.892026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.893166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.893672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.894193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.895195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:14.895776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.897823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.907904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 106/210] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:14.914470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.925728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe89320-b480-431c-854d-f87b2276ba72 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.930731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.932506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.932977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.933432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.934975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.937391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.939366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 105/211] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:14.946186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.957344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a5f6e-935d-4d94-87b5-312563e20842 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.962122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8517f-b10f-4e85-a4db-377078b34069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.963082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8517f-b10f-4e85-a4db-377078b34069 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.963368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8517f-b10f-4e85-a4db-377078b34069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.963676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8517f-b10f-4e85-a4db-377078b34069 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.964973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8517f-b10f-4e85-a4db-377078b34069 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:14.967242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8517f-b10f-4e85-a4db-377078b34069 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:14.969364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 107/212] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:14 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:14.975772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:14.987116 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50148f78-9f94-4cb8-8b09-34e65947aa81 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:14.992321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94aa5c-d188-44b8-a7d4-da1f41572d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:14.993611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94aa5c-d188-44b8-a7d4-da1f41572d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:14.994100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94aa5c-d188-44b8-a7d4-da1f41572d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:14.995152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94aa5c-d188-44b8-a7d4-da1f41572d5e admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/users/94381fecb7f9488eba1dfafeca14fab5/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:14.997814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94aa5c-d188-44b8-a7d4-da1f41572d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4e57e4b88f46b79e1ba71e17c1c216, user_id=94381fecb7f9488eba1dfafeca14fab5, role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:15.000822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94aa5c-d188-44b8-a7d4-da1f41572d5e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:15.016441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 106/213] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:14 2021] PUT /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/users/94381fecb7f9488eba1dfafeca14fab5/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:16.593733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c811d8-e89a-4443-9e57-69fc6d8ebe81 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.594232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c811d8-e89a-4443-9e57-69fc6d8ebe81 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.594303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c811d8-e89a-4443-9e57-69fc6d8ebe81 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.596252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 108/214] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:16.603227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.604195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.604679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.632646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:16.634216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:16.710725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 107/215] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:16.753380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c811d8-e89a-4443-9e57-69fc6d8ebe81 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:16.774072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c811d8-e89a-4443-9e57-69fc6d8ebe81 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:16.784315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:16.785120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.785404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.785681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.801624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:16.808776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:16.810365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 109/216] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:16.816541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:16.826558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e506da9-0457-458e-b3a6-dbc4e457e079 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:16.840619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:16.841907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.842400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.843132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.844264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:16.844902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:16.847280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:16.856962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 108/217] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:16 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:16.862843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:16.876632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a63194-9654-4791-8db7-ad6b7c1667a5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:16.883723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:16.884598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.885448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.885728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.891638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:16.893881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:16.895540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 110/218] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:16 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:16.901814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:16.912083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2b25-42fa-4c8a-b456-d8b969eb21a3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:16.919400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:16.920627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.921112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.921608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.930327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:16.932910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:16.946743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 109/219] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:16 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:16.953837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:16.969293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a5df0f-24da-4f77-ad0b-e7bdd4aaab4a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:16.976265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974aaf4-e2f5-47d9-b2c2-53b1946a666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:16.977403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974aaf4-e2f5-47d9-b2c2-53b1946a666a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:16.977693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974aaf4-e2f5-47d9-b2c2-53b1946a666a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:16.977973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974aaf4-e2f5-47d9-b2c2-53b1946a666a admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:16.980700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974aaf4-e2f5-47d9-b2c2-53b1946a666a admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:16.982836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974aaf4-e2f5-47d9-b2c2-53b1946a666a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:16.985928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 111/220] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:16 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:16.992851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:17.002866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420546ae-8e9d-4a8a-ae05-566798aebe1c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:17.011876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:17.012811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:17.013299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:17.013796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:17.014849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] RBAC: Adding query filter params (role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216, user.id=94381fecb7f9488eba1dfafeca14fab5) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:17.015380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:17.017463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa1ff1-e762-472d-9c37-0b13b363552f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:17.024199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 110/221] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:16 2021] GET /identity/v3/role_assignments?user.id=94381fecb7f9488eba1dfafeca14fab5&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=304db4839fd8407ea7f2e75407363716 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.207280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d897-2be9-4a4a-bbf3-99611e80f832 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.207846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d897-2be9-4a4a-bbf3-99611e80f832 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.207846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d897-2be9-4a4a-bbf3-99611e80f832 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.209797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 112/222] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:18.219686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.220161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.220257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.237218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437db7d-410c-4be8-a313-6522c7d976e5 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.237502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437db7d-410c-4be8-a313-6522c7d976e5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.237781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437db7d-410c-4be8-a313-6522c7d976e5 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.239537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 113/223] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:18.245752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.246043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.246328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.265328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:18.266584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:18.281429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:18.284564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:18.287415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 111/224] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:18.297905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 114/225] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:18.333214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.345573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fccf56-2406-4511-a096-c0b190a4b74d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.355830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.357133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.362229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.362513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.362790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.372858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e57086-dbfa-4a0b-b302-cf5ad622c6ac None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.382734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.383546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.387911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.388210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.392957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:18.402991 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:18.411375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 112/226] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:18.412389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:18.421491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:18.422796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 115/227] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:18.423811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.432660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.446307 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cdc93-a56d-4506-8e62-c4da93f52c4e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.457561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8e3a1-44cb-4847-b6f3-3f31536b5ac0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.458723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.459484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.459794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.460071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.460884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:18.461192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.463022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.477550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.478249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.478571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.478851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.479742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:18.480053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.481756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.483439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 113/228] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:18.489624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.496089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 116/229] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.502043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.509542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad451-dfeb-447a-9111-2d04c690c2cd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.517337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f7ba0-c006-4989-b950-60fbaf4e694d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.519492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.520418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.520797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.521085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.522295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.524358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.525220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.526190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.526481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.526759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.528022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.530293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.531117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 114/230] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:18.532323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.536016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 117/231] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:18.542059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.545626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b186d5d-a00e-4032-a25e-bafec867551d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.558723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdb1a0-0481-462f-93ac-69df833440f1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.560943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.561613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.561903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.562184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.578377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c68131-7ff8-4b63-88c2-c3f7c75ae4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.578970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68131-7ff8-4b63-88c2-c3f7c75ae4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.579259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68131-7ff8-4b63-88c2-c3f7c75ae4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.579546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c68131-7ff8-4b63-88c2-c3f7c75ae4e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.581273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.583044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.600982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68131-7ff8-4b63-88c2-c3f7c75ae4e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.602853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 115/232] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:44:18.602964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c68131-7ff8-4b63-88c2-c3f7c75ae4e5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.611760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.618304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 118/233] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:44:18.619566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07b74-50ce-45e1-b052-356af12ea14e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.619926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07b74-50ce-45e1-b052-356af12ea14e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.620211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd07b74-50ce-45e1-b052-356af12ea14e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.622151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 119/234] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:18.627368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5b17d-33f2-4a60-9ae6-f0e00a4ed1ec admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.636356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.636682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.636925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.640033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.641397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.641917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.642440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.644083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.646156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.648111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 116/235] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:18.650930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.667740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92287759-8c16-4315-8d07-136e83f84015 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.672576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.673448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.673734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.674022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.675235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.676657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:18.677338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.677863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:18.679192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 117/236] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.680003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.691745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c2ed3-999f-446e-9792-befecda1afbf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.694109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 120/237] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:18.694785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.696667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.697870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.698157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.698440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.699303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216, user.id=dce917494d344377a020b14e93b0e3e7) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:18.699644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.702157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.709698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4e2af-0811-4938-8115-051b80962c56 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.712408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 118/238] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/role_assignments?user.id=dce917494d344377a020b14e93b0e3e7&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.728505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.729211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.729503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.729784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.730658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] RBAC: Adding query filter params (role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216, user.id=94381fecb7f9488eba1dfafeca14fab5) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:18.730978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.732878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.739811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 121/239] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/role_assignments?user.id=94381fecb7f9488eba1dfafeca14fab5&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.745356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.755782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb511f67-88e0-4219-865f-f2db123a7a96 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.761109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182479-36be-440e-a884-92129c39748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.762048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182479-36be-440e-a884-92129c39748a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.762336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182479-36be-440e-a884-92129c39748a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.762619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6182479-36be-440e-a884-92129c39748a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.775227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6182479-36be-440e-a884-92129c39748a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:18.783118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-d6182479-36be-440e-a884-92129c39748a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:18.784532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 119/240] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:18.791457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.802699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b60706-195d-48ba-9699-d3ffcb289f8b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.807839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.808585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.808872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.809155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.809996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:18.810309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.812007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eac49e-137a-43d7-abfa-f22b378c7f79 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.826328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 122/241] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.838611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182479-36be-440e-a884-92129c39748a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.852851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6182479-36be-440e-a884-92129c39748a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.860621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.861297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.861636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.861962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.874303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.876167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.887054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 120/242] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:18.892684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826404-c9dc-4ae1-a8b4-d264e5db946b None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.892985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826404-c9dc-4ae1-a8b4-d264e5db946b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.893277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb826404-c9dc-4ae1-a8b4-d264e5db946b None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.895377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 123/243] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:18.898219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.901270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.901564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.901844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.929109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e83c17-78c2-41e0-9896-b0e3b7ae7492 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.935348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:18.940550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:18.941518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:18.941802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:18.942138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:18.942887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:18.948855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:18.953617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:18.960594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 121/244] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:18.971786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:18.974248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 124/245] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 09 04:44:18.989858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b046f2d-a77c-446a-8c7a-8553059e19f4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:18.999874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.000816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.001110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.001393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.012656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.013905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.021897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:19.021897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:19.021897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:19.024607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c470a9-25df-45de-bbf9-d6933b9dd3c9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.027227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.030030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 122/246] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:18 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:19.039143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.039954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.041723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.042484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.042773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.060913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f02955-f29a-4a1f-8fdd-0e39321f05f2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.070837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:19.073285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.073949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.074235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.076292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.077192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:19.077514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.081231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.088931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:19.091046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 125/247] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:19.093148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 123/248] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=304db4839fd8407ea7f2e75407363716 => generated 260 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:19.098142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.109673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1b842-1f59-490a-aab2-63c0986dbad7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.114861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.115608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.115935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.116218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.117072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:19.117386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.119200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.132179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 126/249] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:19.138977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.151193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31eb9-1083-4435-85c7-4d765b81ec13 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.157237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.157988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.158330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.158613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.170506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.172500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.184575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 124/250] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:19.190972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.205409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9071067-90bf-4ecd-8c98-c1d3b51f1f09 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.210987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.211868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.212208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.212548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.220763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.223114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.225059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 127/251] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:19.232248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.242199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcc36d7-4348-42d4-88f9-cb4f862bbb7c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.249336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331692b9-0fce-4153-89f6-bd41de252554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.250265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331692b9-0fce-4153-89f6-bd41de252554 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.250560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331692b9-0fce-4153-89f6-bd41de252554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.250843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331692b9-0fce-4153-89f6-bd41de252554 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.252179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331692b9-0fce-4153-89f6-bd41de252554 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.254267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331692b9-0fce-4153-89f6-bd41de252554 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.256201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 125/252] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:19.262750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:19.273518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa06d7-c55a-4801-9fb5-a56a333a9c1d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:19.278917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:19.279715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:19.280000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:19.280337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:19.281208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:19.281581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:19.283631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933d0a8-3325-4bac-8073-ceb763c01007 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:19.290581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 128/253] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:19 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.163592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1d67-4ab1-4613-bc09-a1fa19f12730 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.163914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1d67-4ab1-4613-bc09-a1fa19f12730 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.164197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca1d67-4ab1-4613-bc09-a1fa19f12730 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.166083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 126/254] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:20.172765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.173064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.173354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.191834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:20.193021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:20.201422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 129/255] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:20.227570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1d67-4ab1-4613-bc09-a1fa19f12730 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.240383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca1d67-4ab1-4613-bc09-a1fa19f12730 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.245316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.246109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.246388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.246660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.257349 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:20.264289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:20.265488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 127/256] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:20.271810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.280853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b56b9-ee0c-4d9c-88cf-1037f21d167e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.285296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.285969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.286256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.286564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.287343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:20.287669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.289272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.298782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 130/257] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.304844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.425177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03734e-1157-412d-8267-08d355bddfbb admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.429893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.430569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.430854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.431138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.440706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.442482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.452081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 128/258] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:20.458380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.468440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667bfe6-20ac-4759-86e5-fba4c66d2fb3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.472852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.473717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.473998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.474278 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.475478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.477664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.479914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 131/259] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.486104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.495873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36012c3e-ba06-4ed7-8de9-5a143501e2a6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.500466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4ab3a5-93aa-432d-9d15-e2a113eea519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.501319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab3a5-93aa-432d-9d15-e2a113eea519 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.501600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab3a5-93aa-432d-9d15-e2a113eea519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.501876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4ab3a5-93aa-432d-9d15-e2a113eea519 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.503123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ab3a5-93aa-432d-9d15-e2a113eea519 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.505119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4ab3a5-93aa-432d-9d15-e2a113eea519 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.506892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 129/260] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.513450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.523680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0197eb90-b663-4368-b66b-89f1bb860db4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.528240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.528957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.529273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.529559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.530474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:20.530896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.532810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047777e-1792-44b2-9745-ec2cdddb9792 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.539002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 132/261] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=304db4839fd8407ea7f2e75407363716 => generated 260 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.572914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf207c-3a2d-43e3-9de5-2d7a6a81f676 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.573203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf207c-3a2d-43e3-9de5-2d7a6a81f676 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.573483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf207c-3a2d-43e3-9de5-2d7a6a81f676 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.575335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 130/262] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:20.582045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.582344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.582665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.605975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:20.607219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:20.618173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 133/263] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:20.660931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf207c-3a2d-43e3-9de5-2d7a6a81f676 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.673909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf207c-3a2d-43e3-9de5-2d7a6a81f676 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.679919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.680732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.681016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.681341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.696550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:20.704675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:20.706198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 131/264] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:20.712793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.722499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f5b8a-987e-41da-8b57-29a57f71dc9e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.729765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.730473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.730759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.731044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.731869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:20.732181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.733991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.743563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 134/265] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:20.750376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.762008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd42cbea-96d8-4069-9426-d72663b2a328 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.771925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.772603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.772943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.773304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.782745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.784646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.799337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 132/266] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:20.806129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.817253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e13e64-f3d1-46c9-90eb-fb42012fdf68 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.824662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.825533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.825874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.826153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.827428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.829622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.831411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 135/267] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.837857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.847255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ee6fd-f246-4702-844a-4600089ad8c3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.852575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fead05-4930-4f7f-baff-875ad624cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.853507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fead05-4930-4f7f-baff-875ad624cce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.853787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fead05-4930-4f7f-baff-875ad624cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.854105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fead05-4930-4f7f-baff-875ad624cce8 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.855309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fead05-4930-4f7f-baff-875ad624cce8 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.857371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fead05-4930-4f7f-baff-875ad624cce8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.859390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 133/268] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:20.865700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:20.879570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c406d4b-8589-4e46-b456-cdea91cf8a8b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:20.885480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:20.886340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:20.886777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:20.887215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:20.888267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:20.888732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:20.890790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57607c-b8cb-470c-8158-cb18b6ef10fd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:20.897288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 136/269] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:20 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:21.110189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47089f90-c442-4c3a-aea6-33307e995f7d None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.110519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47089f90-c442-4c3a-aea6-33307e995f7d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.110691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47089f90-c442-4c3a-aea6-33307e995f7d None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.112697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 134/270] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:21.119998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.120590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.121095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.148719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:21.150371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:21.158366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 137/271] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:21.195287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47089f90-c442-4c3a-aea6-33307e995f7d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:21.212385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47089f90-c442-4c3a-aea6-33307e995f7d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:21.217996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:21.218802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.219143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.219461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.234794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:21.242016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:21.243255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 135/272] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:21.250052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:21.265405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41365a1-ef87-4c75-994a-ff9e50d8775f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:21.277175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:21.278582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.279163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.279663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.280675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:21.281185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:21.283011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:21.294126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 138/273] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:21.302857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:21.313311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57358c7b-34f9-47f9-87ae-3153f9b046a4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:21.320278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:21.320911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.321190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.321631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.330443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:21.333685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:21.343015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 136/274] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:21.349845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:21.361601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a539ad-7c11-4dcc-9085-f4cc83519448 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:21.370931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:21.372157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.372683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.373131 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] PATH_INFO: `/v3/projects/98146912a4594b47b6620b2e1ee83d93` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.374656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] RBAC: Authorizing `identity:get_project(project_id=98146912a4594b47b6620b2e1ee83d93)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:21.377442 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:21.379815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 139/275] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:21 2021] GET /identity/v3/projects/98146912a4594b47b6620b2e1ee83d93 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:21.386218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:21.398103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740d206-33a3-4717-bbed-12fc3340ea22 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:21.403017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f379fdd-811b-4e78-b120-b4ca141404b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:21.404121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f379fdd-811b-4e78-b120-b4ca141404b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.404579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f379fdd-811b-4e78-b120-b4ca141404b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.405044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f379fdd-811b-4e78-b120-b4ca141404b8 admin admin] PATH_INFO: `/v3/groups/9251035a02254522bae16eb33ba55984` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.420625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f379fdd-811b-4e78-b120-b4ca141404b8 admin admin] RBAC: Authorizing `identity:get_group(group_id=9251035a02254522bae16eb33ba55984)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:21.422853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f379fdd-811b-4e78-b120-b4ca141404b8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:21.424858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 137/276] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:21 2021] GET /identity/v3/groups/9251035a02254522bae16eb33ba55984 => generated 229 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:21.431419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:21.449803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4352461-434c-4453-b348-b13df89f1773 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:21.459813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:21.460474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:21.460783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:21.461034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:21.461894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] RBAC: Adding query filter params (group.id=9251035a02254522bae16eb33ba55984, role.id=94424be31c964c5686644e854119e1dc, scope.project.id=98146912a4594b47b6620b2e1ee83d93) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:21.462204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:21.468195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59341ee5-58d7-426d-94ba-1e48fc3bfbcf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:21.474530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 140/277] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:21 2021] GET /identity/v3/role_assignments?group.id=9251035a02254522bae16eb33ba55984&scope.project.id=98146912a4594b47b6620b2e1ee83d93&role.id=94424be31c964c5686644e854119e1dc => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.114530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467928a-4cae-41d0-8e3c-04319da400c9 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.115255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467928a-4cae-41d0-8e3c-04319da400c9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.115788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467928a-4cae-41d0-8e3c-04319da400c9 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.117724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 138/278] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:22.123973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.124277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.124557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.142374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:22.143560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:22.156297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 141/279] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:22.202308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467928a-4cae-41d0-8e3c-04319da400c9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.220736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467928a-4cae-41d0-8e3c-04319da400c9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.226124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.226932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.227216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.227489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.245066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:22.252376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:22.253760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 139/280] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:22.260439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.270065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8added5-2aa7-415a-b4ef-0e7c15c795a8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.280366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.281118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.281407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.281693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.282498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:22.282818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.284550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.300149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 142/281] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.306425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.316469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eb47e-62f7-4c81-95af-3d75eae27e30 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.327366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.328260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.328547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.328826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.330047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.332102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.333720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 140/282] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.340502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.350599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31487d0-081f-4679-86f0-519adbb4816e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.359652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eca189-a1b9-4350-8cf1-997ae01e70ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.360567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eca189-a1b9-4350-8cf1-997ae01e70ed admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.360895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eca189-a1b9-4350-8cf1-997ae01e70ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.361212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eca189-a1b9-4350-8cf1-997ae01e70ed admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.362484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eca189-a1b9-4350-8cf1-997ae01e70ed admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.364761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eca189-a1b9-4350-8cf1-997ae01e70ed admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.366463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 143/283] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.372846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.383602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94860a7-a5c2-40aa-9c22-5d0e0b1fbede admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.393272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f39e6e-eb97-4173-b9a5-d6a23aef9d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.394250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39e6e-eb97-4173-b9a5-d6a23aef9d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.394535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39e6e-eb97-4173-b9a5-d6a23aef9d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.394813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f39e6e-eb97-4173-b9a5-d6a23aef9d72 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/groups/552282a67425401281762ee6339c59ea/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.397207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f39e6e-eb97-4173-b9a5-d6a23aef9d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c32f041464e76b60eaf53f01b9ee8, group_id=552282a67425401281762ee6339c59ea, role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.401108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f39e6e-eb97-4173-b9a5-d6a23aef9d72 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.424319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 141/284] 10.222.0.41 () {58 vars in 1463 bytes} [Tue Nov 9 04:44:22 2021] PUT /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/groups/552282a67425401281762ee6339c59ea/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:44:22.426292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0400-7abc-4dd7-bf8d-8ccdeb66e2cb None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.426585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0400-7abc-4dd7-bf8d-8ccdeb66e2cb None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.426867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0400-7abc-4dd7-bf8d-8ccdeb66e2cb None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.428779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 144/285] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:22.440894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.440894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.440894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.466783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:22.470094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:22.542699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 142/286] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:22 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:22.569163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0400-7abc-4dd7-bf8d-8ccdeb66e2cb None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.585780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0400-7abc-4dd7-bf8d-8ccdeb66e2cb None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.591355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.592454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.592966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.593427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.605417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:22.614957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:22.616637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 145/287] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:22.624573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.634495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7511d10-c3a4-4224-a5bb-c6a979bf8070 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.640064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.640998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.641472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.641925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.642971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:22.643493 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.645420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.656868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 143/288] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.663511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.675888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30212e4-90b2-4b59-84ee-5be0016fd770 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.680927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.682094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.682599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.683142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.685963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.687797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:22.687797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:22.687797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:22.689507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.695659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 146/289] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.704488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.716808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce9775-fced-4286-ab4e-9b1b926a3020 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.723817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7357d1-7f1e-4790-b199-f02c57bc2d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.725011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7357d1-7f1e-4790-b199-f02c57bc2d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.725582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7357d1-7f1e-4790-b199-f02c57bc2d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.726039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7357d1-7f1e-4790-b199-f02c57bc2d0f admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.727544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7357d1-7f1e-4790-b199-f02c57bc2d0f admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.730026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7357d1-7f1e-4790-b199-f02c57bc2d0f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.732425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 144/290] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:22 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:22.739175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:22.749963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3056d-8b68-49dd-ab5e-0daa32bcf3cf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:22.755281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa9440-2edf-464e-8f6d-f2ad5cd088fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:22.756583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9440-2edf-464e-8f6d-f2ad5cd088fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:22.757063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9440-2edf-464e-8f6d-f2ad5cd088fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:22.757557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa9440-2edf-464e-8f6d-f2ad5cd088fa admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/groups/552282a67425401281762ee6339c59ea/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:22.760804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa9440-2edf-464e-8f6d-f2ad5cd088fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c32f041464e76b60eaf53f01b9ee8, group_id=552282a67425401281762ee6339c59ea, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:22.763922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa9440-2edf-464e-8f6d-f2ad5cd088fa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:22.786557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 147/291] 10.222.0.41 () {58 vars in 1463 bytes} [Tue Nov 9 04:44:22 2021] PUT /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8/groups/552282a67425401281762ee6339c59ea/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:23.477772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee781bc-389b-4f1a-a057-889a40e45da3 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.478280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee781bc-389b-4f1a-a057-889a40e45da3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.478909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee781bc-389b-4f1a-a057-889a40e45da3 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.481021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 145/292] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:23.487395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.487882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.487975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.639217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:23.640448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:23.713431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 148/293] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:23.750302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee781bc-389b-4f1a-a057-889a40e45da3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:23.762578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee781bc-389b-4f1a-a057-889a40e45da3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:23.771136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:23.771971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.772277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.772542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.783843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:23.794922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:23.796609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 146/294] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:23.803148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:23.812382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceff2e-f88b-4921-a8bb-f8cd6525badb None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:23.819105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:23.819809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.820099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.820381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.821160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:23.821471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:23.823121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:23.832141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 149/295] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:23.839264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:23.849777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f90a6b-73fa-4904-a5b7-0d0264507aa6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:23.859192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:23.860083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.860368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.860643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.861828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:23.863776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:23.865534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 147/296] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:23 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:23.872037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:23.884824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d133a-86e1-45fc-b378-87393eb45cb5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:23.889261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca36169-6107-4f9f-adc6-12f2daf20edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:23.890124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca36169-6107-4f9f-adc6-12f2daf20edc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.890407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca36169-6107-4f9f-adc6-12f2daf20edc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.890698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca36169-6107-4f9f-adc6-12f2daf20edc admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.891931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca36169-6107-4f9f-adc6-12f2daf20edc admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:23.893976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca36169-6107-4f9f-adc6-12f2daf20edc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:23.895853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 150/297] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:23 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:23.903019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:23.912893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44fc46-8759-438f-b87d-8cdc8a3aa71d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:23.920481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ed7af-3265-47de-8df1-7998f6443da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:23.921370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ed7af-3265-47de-8df1-7998f6443da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:23.921653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ed7af-3265-47de-8df1-7998f6443da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:23.921929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ed7af-3265-47de-8df1-7998f6443da9 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/groups/552282a67425401281762ee6339c59ea/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:23.928978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ed7af-3265-47de-8df1-7998f6443da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4e57e4b88f46b79e1ba71e17c1c216, group_id=552282a67425401281762ee6339c59ea, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:23.931682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ed7af-3265-47de-8df1-7998f6443da9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:23.956235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 148/298] 10.222.0.41 () {58 vars in 1463 bytes} [Tue Nov 9 04:44:23 2021] PUT /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/groups/552282a67425401281762ee6339c59ea/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:24.236729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a618b4-9fef-4eee-8d24-02e4f33a988b None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.237106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a618b4-9fef-4eee-8d24-02e4f33a988b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.237296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a618b4-9fef-4eee-8d24-02e4f33a988b None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.239343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 151/299] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:24.247972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.248321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.248533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.271026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:24.272261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:24.350217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 149/300] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:24.375068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a618b4-9fef-4eee-8d24-02e4f33a988b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.397765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a618b4-9fef-4eee-8d24-02e4f33a988b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.404945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.405760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.406048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.406323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.424590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:24.432528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:24.433981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 152/301] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:24.440445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.450098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087457b6-601a-41e6-a833-6cc213411f00 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.463883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.464559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.464843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.465117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.465901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:24.466206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:24.467819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:24.484067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 150/302] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:24.490124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.504859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe77813-a62b-4633-8d3b-13e0e352a59a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.512150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.513031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.513322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.513605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.520663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:24.522664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:24.524717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 153/303] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:24.531208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.541506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65581b3e-538f-464f-af93-7017ced15e0f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.552142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603f169-72a4-44b9-87c0-a0c617322fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.553030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f169-72a4-44b9-87c0-a0c617322fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.553317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f169-72a4-44b9-87c0-a0c617322fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.553592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603f169-72a4-44b9-87c0-a0c617322fc2 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.560095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f169-72a4-44b9-87c0-a0c617322fc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:24.562247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603f169-72a4-44b9-87c0-a0c617322fc2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:24.564152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 151/304] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:24.575253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.589059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08ac92-98c5-46ae-8da5-2456d22e97d7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.599853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b1f2b-78f3-4249-9da6-dd7dd46b0785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.600753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1f2b-78f3-4249-9da6-dd7dd46b0785 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.601039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1f2b-78f3-4249-9da6-dd7dd46b0785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.601320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b1f2b-78f3-4249-9da6-dd7dd46b0785 admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/groups/552282a67425401281762ee6339c59ea/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.608998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b1f2b-78f3-4249-9da6-dd7dd46b0785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b4e57e4b88f46b79e1ba71e17c1c216, group_id=552282a67425401281762ee6339c59ea, role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:24.611855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b1f2b-78f3-4249-9da6-dd7dd46b0785 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:24.634545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 154/305] 10.222.0.41 () {58 vars in 1463 bytes} [Tue Nov 9 04:44:24 2021] PUT /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216/groups/552282a67425401281762ee6339c59ea/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:24.709494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19239-ae3b-4a58-8079-55ff6eb2aeee None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.709854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19239-ae3b-4a58-8079-55ff6eb2aeee None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.710053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff19239-ae3b-4a58-8079-55ff6eb2aeee None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.711913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 152/306] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:24.719157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.719457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.719776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.744815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:24.745954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:24.824045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 155/307] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:24.867604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff19239-ae3b-4a58-8079-55ff6eb2aeee None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.885982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff19239-ae3b-4a58-8079-55ff6eb2aeee None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.895193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.896036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.896329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.896587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.917929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:24.925165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:24.926726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 153/308] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:24.933719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:24.949815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0026d5-c61b-49dd-90fc-4befbd19b350 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:24.960941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:24.961635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:24.961924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:24.962204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:24.963574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:24.963954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:24.965570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:24.983486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 156/309] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:24.989811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:25.000502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22821ae4-15ec-49a5-9cfc-bb3f934c6c73 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:25.010378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:25.011229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.011511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.011801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] PATH_INFO: `/v3/groups/9251035a02254522bae16eb33ba55984` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.013430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] RBAC: Authorizing `identity:get_group(group_id=9251035a02254522bae16eb33ba55984)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:25.015328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:25.017245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 154/310] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:24 2021] GET /identity/v3/groups/9251035a02254522bae16eb33ba55984 => generated 229 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:25.023435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:25.034832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537091-5454-4b95-a950-9adbb1aaaae5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:25.039297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926dc0e-f61b-4777-93d1-3629f1c52da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:25.040182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926dc0e-f61b-4777-93d1-3629f1c52da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.040474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926dc0e-f61b-4777-93d1-3629f1c52da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.040781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926dc0e-f61b-4777-93d1-3629f1c52da4 admin admin] PATH_INFO: `/v3/projects/98146912a4594b47b6620b2e1ee83d93` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.041996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926dc0e-f61b-4777-93d1-3629f1c52da4 admin admin] RBAC: Authorizing `identity:get_project(project_id=98146912a4594b47b6620b2e1ee83d93)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:25.043833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926dc0e-f61b-4777-93d1-3629f1c52da4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:25.046132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 157/311] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:25 2021] GET /identity/v3/projects/98146912a4594b47b6620b2e1ee83d93 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:25.052193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:25.066977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc3d5d-982f-4118-a5d1-21d732b46176 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:25.073243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bfd05-97bc-4218-a38f-c8eea2393ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:25.074171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bfd05-97bc-4218-a38f-c8eea2393ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.074447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bfd05-97bc-4218-a38f-c8eea2393ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.074775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bfd05-97bc-4218-a38f-c8eea2393ebd admin admin] PATH_INFO: `/v3/projects/98146912a4594b47b6620b2e1ee83d93/groups/9251035a02254522bae16eb33ba55984/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.077274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bfd05-97bc-4218-a38f-c8eea2393ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98146912a4594b47b6620b2e1ee83d93, group_id=9251035a02254522bae16eb33ba55984, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:25.080050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bfd05-97bc-4218-a38f-c8eea2393ebd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:25.102759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 155/312] 10.222.0.41 () {58 vars in 1463 bytes} [Tue Nov 9 04:44:25 2021] PUT /identity/v3/projects/98146912a4594b47b6620b2e1ee83d93/groups/9251035a02254522bae16eb33ba55984/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:25.738966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8c31e-9ae6-469c-bbf4-9e6be5de8763 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.740006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8c31e-9ae6-469c-bbf4-9e6be5de8763 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.740498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8c31e-9ae6-469c-bbf4-9e6be5de8763 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.742475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 158/313] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:25.749694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.750569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.751065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.776099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:25.777620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:25.862589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 156/314] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:25.898492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8c31e-9ae6-469c-bbf4-9e6be5de8763 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:25.912912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8c31e-9ae6-469c-bbf4-9e6be5de8763 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:25.921344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12003873-5df6-495f-93ae-9963c2fdf399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:25.922399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003873-5df6-495f-93ae-9963c2fdf399 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.922887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003873-5df6-495f-93ae-9963c2fdf399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.923406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12003873-5df6-495f-93ae-9963c2fdf399 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.937361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12003873-5df6-495f-93ae-9963c2fdf399 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:25.945027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-12003873-5df6-495f-93ae-9963c2fdf399 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:25.946462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 159/315] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:25 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:25.953149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:25.963159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08c836-7254-479f-8e7f-82ad98bac8a6 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:25.967612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86c0b-b666-4dae-a3f4-9a6eb9933d56 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.967931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86c0b-b666-4dae-a3f4-9a6eb9933d56 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.968214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae86c0b-b666-4dae-a3f4-9a6eb9933d56 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.970481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 160/316] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:25.976270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:25.976997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.977282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.977557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:25.979017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:25.979325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:25.980999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:25.984989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:25.985272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:25.985599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.003135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 157/317] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:25 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.008222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:26.009197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.016072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:26.020962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769e240-af79-48c2-bd73-aa3a609c7ed5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.030539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.031233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.031607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.031908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.038710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 161/318] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:26.046159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.047956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.061075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 158/319] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:44:26.067401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.076316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.078712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38e7ad-9c4c-4ced-8826-44df01b5bb61 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.085391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.086307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.086595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.086876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.088693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d953ed-f909-4666-b9ad-3b056238390b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.088803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.092289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.094732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 162/320] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.100392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.101198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.101478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.101747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.102049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.113503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa094ffe-1f24-4ade-aae7-445d9f325135 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.119758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.121076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.121576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.122076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.123499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.125561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.127600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 163/321] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.136088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.136346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:26.143322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:26.144853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 159/322] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:26.148888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5c4ad-8293-4f22-86e5-f4d88ad59065 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.152607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.154609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.155326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.155637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.156036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.156956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:26.157277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.159306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.168420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 164/323] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 611 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.170102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8904085-97da-4992-908c-f6549714e440 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.189570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.190284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.190572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.190849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.191678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:26.191994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.193672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.211370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 160/324] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.218247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.231952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48924a-15cf-4345-b725-00533896459f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.249524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.250251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.250540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.250821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.261342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.263177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.283299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 165/325] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:26.290673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.314486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc53792-f031-470d-86b3-7a698734081a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.329584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.330491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.330774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.331086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.332363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.334435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.336438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 161/326] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.342985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.356191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3bb15-b904-41c4-879c-a658da509208 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.364003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43691317-ca9b-45c7-9dcb-de755a16beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.364816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43691317-ca9b-45c7-9dcb-de755a16beb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.365160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43691317-ca9b-45c7-9dcb-de755a16beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.365445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43691317-ca9b-45c7-9dcb-de755a16beb7 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.366705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43691317-ca9b-45c7-9dcb-de755a16beb7 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.368758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43691317-ca9b-45c7-9dcb-de755a16beb7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.370744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 166/327] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.377046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.393195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475a646-5ebf-4a2b-b071-c6e1ec2530a4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.404546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.405239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.405529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.405807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.406689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:26.407066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.408962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac6feda-02c0-4e89-8394-09b9468f19cc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.421080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 162/328] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8&role.id=304db4839fd8407ea7f2e75407363716 => generated 611 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.820417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc047-64a9-41d4-94f5-94fbd31d9732 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.820941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc047-64a9-41d4-94f5-94fbd31d9732 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.821017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bc047-64a9-41d4-94f5-94fbd31d9732 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.823342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 167/329] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:26.829658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.830445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.830891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.849887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:26.851406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:26.860357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 163/330] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:26.885661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bc047-64a9-41d4-94f5-94fbd31d9732 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.899698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bc047-64a9-41d4-94f5-94fbd31d9732 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.904774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.905624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.905914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.906193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.918554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:26.925784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 09 04:44:26.927245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 168/331] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:26.934033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.945109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84727-6225-4aa4-a372-53543a91cf75 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.950221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.950938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.951229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.951509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.952366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:26.952675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:26.954314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:26.963601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 164/332] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:26.971208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:26.982652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cfbb0-c0ed-4e2c-a588-405f65a82503 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:26.988222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:26.989073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:26.989359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:26.989637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:26.998813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.000677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.009839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 169/333] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:27.015896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.025936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd66d8-c4ee-4b71-81fe-c8132def4fc3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.030424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.031340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.031696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.031981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.034720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.036804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.038643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 165/334] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:27.045043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.058033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e94b6-b989-4221-ae7d-6fef0ac71bcb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.063466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df47cd-f00e-4bea-8ddb-b07fb477de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.064351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df47cd-f00e-4bea-8ddb-b07fb477de75 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.064639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df47cd-f00e-4bea-8ddb-b07fb477de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.065012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df47cd-f00e-4bea-8ddb-b07fb477de75 admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.066107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df47cd-f00e-4bea-8ddb-b07fb477de75 admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.068106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df47cd-f00e-4bea-8ddb-b07fb477de75 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.069819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 170/335] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.076186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.085879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dded57-07af-498c-a09f-79b66da3454b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.090659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.091405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.091730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.092014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.092921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=304db4839fd8407ea7f2e75407363716, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:27.093262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.095138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a18859-1c86-42f3-a48a-fd262cfe92b3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.101929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 166/336] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=304db4839fd8407ea7f2e75407363716 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.437477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5b3d-c445-4edb-adf7-56dd90dfd1a5 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.438073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5b3d-c445-4edb-adf7-56dd90dfd1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.438355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e5b3d-c445-4edb-adf7-56dd90dfd1a5 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.440179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 171/337] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:27.446479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.446774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.447116 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.465681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:27.466858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:27.476414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 167/338] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:27.501731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e5b3d-c445-4edb-adf7-56dd90dfd1a5 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.514120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e5b3d-c445-4edb-adf7-56dd90dfd1a5 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.518343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.519137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.519422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.519730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.530211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:27.537410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:27.538581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 172/339] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:27.545770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.554640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3f9ad-31c9-4270-9503-f3cc5a39e4b3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.558953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.559608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.559939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.560217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.560977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:27.561285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.562871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.571289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 168/340] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.577150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.586544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cd1ca-1b71-4b6b-82fa-8fcf40bb0baa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.591334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.591996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.592285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.592563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.600519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.602265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.611181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 173/341] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:27.617044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.626476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dc1be-aa31-499e-9e61-212664f18856 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.630771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.631603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.631922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.632194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.633359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.635417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.637187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 169/342] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.643568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.653465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6b2f0-e057-4221-b452-4194eac8b6a4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.657948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd14a9-779d-453d-8716-05389139f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.658910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd14a9-779d-453d-8716-05389139f51b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.659191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd14a9-779d-453d-8716-05389139f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.659467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd14a9-779d-453d-8716-05389139f51b admin admin] PATH_INFO: `/v3/groups/552282a67425401281762ee6339c59ea` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.660781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd14a9-779d-453d-8716-05389139f51b admin admin] RBAC: Authorizing `identity:get_group(group_id=552282a67425401281762ee6339c59ea)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.662715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd14a9-779d-453d-8716-05389139f51b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.664441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 174/343] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/groups/552282a67425401281762ee6339c59ea => generated 226 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.671986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.681755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f32a3-32ae-48b6-9b63-943508d0553a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.686163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.686817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.687106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.687386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.688329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] RBAC: Adding query filter params (group.id=552282a67425401281762ee6339c59ea, role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:27.688597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.690918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a2e0d-50c9-438d-9dbe-0a6fc69c95f5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.697837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 170/344] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/role_assignments?group.id=552282a67425401281762ee6339c59ea&scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.793488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dfa99-5f89-4bdf-b738-43260e57be95 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.793775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dfa99-5f89-4bdf-b738-43260e57be95 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.794053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dfa99-5f89-4bdf-b738-43260e57be95 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.796145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 175/345] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:27.802425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.802720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.803002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.821398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:27.823173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:27.830987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 171/346] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:27.855646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dfa99-5f89-4bdf-b738-43260e57be95 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.868154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dfa99-5f89-4bdf-b738-43260e57be95 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.872211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.873012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.873293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.873568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.884218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:27.891568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:27.892798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 176/347] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:27.899137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.908796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c932ae-f4ea-4336-ba93-b8211a90d1ba None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.913224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.913879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.914166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.914440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.915202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:27.915516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.917147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.925975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 172/348] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:27.932213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.941824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d52f82-17fa-4364-95bc-6f78bbf218f8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.946057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.946691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.947504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.947825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.956273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.958078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.967821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 177/349] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:27.974092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:27.983757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cda21-ab9c-40ab-8985-e500aaa11f27 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:27.988024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:27.988858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:27.989137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:27.989412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] PATH_INFO: `/v3/projects/98146912a4594b47b6620b2e1ee83d93` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:27.990584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] RBAC: Authorizing `identity:get_project(project_id=98146912a4594b47b6620b2e1ee83d93)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:27.992440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:27.994110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 173/350] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/projects/98146912a4594b47b6620b2e1ee83d93 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:28.000226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:28.009128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ad782-3ff4-460c-98c9-aff966f69f18 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:28.014061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a4d1-dacf-4bbd-9251-041a6fbd97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:28.014900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a4d1-dacf-4bbd-9251-041a6fbd97f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:28.015182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a4d1-dacf-4bbd-9251-041a6fbd97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:28.015457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a4d1-dacf-4bbd-9251-041a6fbd97f9 admin admin] PATH_INFO: `/v3/groups/9251035a02254522bae16eb33ba55984` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:28.016782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a4d1-dacf-4bbd-9251-041a6fbd97f9 admin admin] RBAC: Authorizing `identity:get_group(group_id=9251035a02254522bae16eb33ba55984)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:28.018739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a4d1-dacf-4bbd-9251-041a6fbd97f9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:28.020555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 178/351] 10.222.0.41 () {56 vars in 1201 bytes} [Tue Nov 9 04:44:27 2021] GET /identity/v3/groups/9251035a02254522bae16eb33ba55984 => generated 229 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:28.026623 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:28.036400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63e3e9-4e89-4ea2-90de-e1a6a56caf23 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:28.041273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:28.041908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:28.042191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:28.042464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:28.043303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] RBAC: Adding query filter params (group.id=9251035a02254522bae16eb33ba55984, role.id=94424be31c964c5686644e854119e1dc, scope.project.id=98146912a4594b47b6620b2e1ee83d93) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:28.043609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:28.045721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c51910-01ea-4642-8570-a56b2ff23f42 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:28.051761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 174/352] 10.222.0.41 () {56 vars in 1397 bytes} [Tue Nov 9 04:44:28 2021] GET /identity/v3/role_assignments?group.id=9251035a02254522bae16eb33ba55984&scope.project.id=98146912a4594b47b6620b2e1ee83d93&role.id=94424be31c964c5686644e854119e1dc => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:30.692038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd260f78-946a-456a-bf6d-487b5d6feb1e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.692565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd260f78-946a-456a-bf6d-487b5d6feb1e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.692654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd260f78-946a-456a-bf6d-487b5d6feb1e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.694629 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 179/353] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:30.701496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.701964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.702048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.727723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:30.728959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:30.742105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 175/354] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:30.790132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd260f78-946a-456a-bf6d-487b5d6feb1e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:30.803795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd260f78-946a-456a-bf6d-487b5d6feb1e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:30.809180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:30.810004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.810276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.810552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.826126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:30.827922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:30.851748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:30.853595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 180/355] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:30.859515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:30.868817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07e2b8-c721-4d46-8ee2-86e7d0d51bb3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:30.878574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:30.879503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.880001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.880487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.881422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:30.881932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:30.883122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:30.883122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:30.883122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:30.884898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce2181-16fb-4071-b43c-2f9bdd507b2a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:30.911578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 176/356] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:30.917861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:30.932643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5e82-8262-4457-89a3-5c1a8ecc62b1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:30.944957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:30.945281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dac40-1ff2-4aff-b61c-4dacbf57dda4 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.945645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.945933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.946040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dac40-1ff2-4aff-b61c-4dacbf57dda4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.946207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.946571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dac40-1ff2-4aff-b61c-4dacbf57dda4 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.947494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:30.949450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:30.949604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 177/357] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:30.965351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:30.965890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:30.966453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:30.975866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 181/358] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:30 2021] POST /identity/v3/users => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:30.990806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:30.992089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:31.006114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 178/359] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:31.032757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.046907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba13c-8d48-4c67-a0a7-bf62141833fd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.061167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.061995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.062286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.062569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.075010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.077028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.104572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:31.106167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 182/360] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:31.112705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.124748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f26aeba-b4d3-4baa-ac22-7d89734dcf27 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.132286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.132967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.133255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.133533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.134288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:31.135169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.136793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4913d-9120-4fbd-b903-aa3362ab299b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.151044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 179/361] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:31.157284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.173409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853cc946-c5df-4183-8ae5-02cb28dbc49e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.178671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adb99a-7dc7-4a7a-9866-a5f472a7cadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.179355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adb99a-7dc7-4a7a-9866-a5f472a7cadb admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.179657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adb99a-7dc7-4a7a-9866-a5f472a7cadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.179946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adb99a-7dc7-4a7a-9866-a5f472a7cadb admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.180700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adb99a-7dc7-4a7a-9866-a5f472a7cadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.183235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adb99a-7dc7-4a7a-9866-a5f472a7cadb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.227432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 183/362] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:31 2021] POST /identity/v3/users => generated 248 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:31.461448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac71-04c3-408e-b85b-0264f2c5b498 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.461814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac71-04c3-408e-b85b-0264f2c5b498 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.462006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac71-04c3-408e-b85b-0264f2c5b498 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.464101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 180/363] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:31.470512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f0d-cde9-498e-a94d-2aad3171d816 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.470860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f0d-cde9-498e-a94d-2aad3171d816 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.471142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc62f0d-cde9-498e-a94d-2aad3171d816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.492322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4bc62f0d-cde9-498e-a94d-2aad3171d816 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:31.493518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4bc62f0d-cde9-498e-a94d-2aad3171d816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:31.503117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 184/364] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:31.530621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac71-04c3-408e-b85b-0264f2c5b498 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.537116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e073c-06ca-40fd-8f63-c313073ca6f3 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.537404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e073c-06ca-40fd-8f63-c313073ca6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.537814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e073c-06ca-40fd-8f63-c313073ca6f3 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.539722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 185/365] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:31.545831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac71-04c3-408e-b85b-0264f2c5b498 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.546078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.546333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.546615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.555745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.556601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.556891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.557170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.565588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:31.566839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:31.574207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.576294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.577046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 186/366] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:31.596983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:31.598730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 181/367] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:31.603547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.604983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.613926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743f515-dabf-4549-9fc6-a9d78b21147f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.614796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3b19a1-9dc0-4a51-8a17-87b91025de8a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.619421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.619760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.620424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.620706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.620982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.621388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.621815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:31.622123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.622316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.622815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.623750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.634134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.636636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.638342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 182/368] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:31.645438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.659050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:31.659218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a06bb4-f0fa-45b9-b99b-e412c59fc87b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.660700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 187/369] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:31.667262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.667948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.668683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.668974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.669309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.670057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.671438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:31.671438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:31.671438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:31.672756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca08b1a-5e99-46bb-9ce6-23a27835a032 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.678066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e989f-afec-4b30-aaef-7b6d2ea6df8e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.682532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.683197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.683482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.683810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.684566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:31.684876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.686480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.700117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 188/370] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:31.706181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:31.707716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 183/371] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:31 2021] POST /identity/v3/users => generated 248 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:31.718025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5880b4-aa92-4d92-bd41-7a45fc51d2e7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:31.722759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdac3d-a444-4686-956b-067dec1ac704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:31.723486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdac3d-a444-4686-956b-067dec1ac704 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:31.723812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdac3d-a444-4686-956b-067dec1ac704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:31.724091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdac3d-a444-4686-956b-067dec1ac704 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:31.724875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdac3d-a444-4686-956b-067dec1ac704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:31.727013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdac3d-a444-4686-956b-067dec1ac704 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:31.751244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 189/372] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:31 2021] POST /identity/v3/users => generated 249 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:32.203360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd17e2e-6285-4bd1-b751-6e838e8c1537 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:32.203784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd17e2e-6285-4bd1-b751-6e838e8c1537 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:32.203956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd17e2e-6285-4bd1-b751-6e838e8c1537 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:32.206015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 184/373] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:32.212394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:32.213259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:32.213543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:32.240640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:32.241858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:32.249672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 190/374] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:32.274131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd17e2e-6285-4bd1-b751-6e838e8c1537 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:32.287449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd17e2e-6285-4bd1-b751-6e838e8c1537 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:32.291933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:32.292592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:32.292879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:32.293162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:32.294007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:32.295959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:32.303497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.sql.core [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 09 04:44:32.303497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 09 04:44:32.303497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [parameters: {'id': '310a2351ebe842989e2aba76dcbf5d31', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 09 04:44:32.303497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79032) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 09 04:44:32.318480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 09 04:44:32.320094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 185/375] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:44:32 2021] POST /identity/v3/roles => generated 144 bytes in 46 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:32.327562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:32.336918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d38e48-f8d8-4998-b4d3-6bc2385bd58a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:32.342180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907598bc-efa6-4009-bbd3-63965a86ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:32.342998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907598bc-efa6-4009-bbd3-63965a86ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:32.343288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907598bc-efa6-4009-bbd3-63965a86ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:32.343574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907598bc-efa6-4009-bbd3-63965a86ccd7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:32.354722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907598bc-efa6-4009-bbd3-63965a86ccd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:32.362316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-907598bc-efa6-4009-bbd3-63965a86ccd7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 09 04:44:32.363922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 191/376] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:32.381131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:32.394950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7a4d-7f84-46a5-9d90-3441e34ed6be admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:32.401709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:32.402387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:32.402673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:32.403009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:32.403917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:32.404234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:32.406047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67801b6-854b-463d-888c-03a438c057c4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:32.415455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 186/377] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:33.997173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e13c7-54b7-4fd8-89bf-f50d39d139be None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:33.997733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e13c7-54b7-4fd8-89bf-f50d39d139be None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:33.997733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3e13c7-54b7-4fd8-89bf-f50d39d139be None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:33.999827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 192/378] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:34.013895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.014393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.014472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.037094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:34.038305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:34.048954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 187/379] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:34.096550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e13c7-54b7-4fd8-89bf-f50d39d139be None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.111062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3e13c7-54b7-4fd8-89bf-f50d39d139be None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.115509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.116331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.116625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.116908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.130546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:34.140140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:34.142385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 193/380] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:34.149016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.160892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c63f8c-b442-429a-96ea-042569b11c38 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.172129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.172817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.173105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.173570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.174389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.174955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.177748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.189271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 188/381] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.195523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.213744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166295d-8688-4acf-a00b-d34c56b303e9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.223445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.224310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.224701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.225187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.243351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.245836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.269333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:34.270886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 194/382] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:34.276901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.286928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b5e3a-7a9b-4543-8a80-0561235b2b84 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.296246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.296981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.297267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.297597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.298360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.298669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.300369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.316565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 189/383] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.322876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.333435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e3a7d-2fce-45ee-9ab9-82ec2e45f013 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.340938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.341748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.342036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.342316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.352892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.355505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.370936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-708d8908-03ba-444a-8e7b-dd70a2cfe069 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:44:34.372360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 195/384] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:34.378765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.388921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b92f7-534f-47d3-a31c-66e94221d319 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.400516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.401240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.401527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.401808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.402723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.403033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.404119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:34.404119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:34.404119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:34.405336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.427895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e34ff-d9b1-4d0c-8e3f-76058d8a81ae None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.428200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e34ff-d9b1-4d0c-8e3f-76058d8a81ae None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.428465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e34ff-d9b1-4d0c-8e3f-76058d8a81ae None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.430425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 196/385] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:34.436651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.436973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.437213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.458970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 190/386] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.465974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.467886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:34.469091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:34.477283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 197/387] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:34.477828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2ee0d-5a97-4691-a479-49b925a63537 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.493710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.494723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.495210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.495706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.500683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.514760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e036f-7e5b-49c0-b96c-bc0b2bcad3b0 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.520390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.526489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.532415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.533270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.533800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.534143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.546639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 191/388] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:44:34.550426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:34.557494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:34.558854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 198/389] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:34.559703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.565947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.570953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f9813-dbc1-400d-ab2e-be5a3dcd847c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.579667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.580549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.580834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.582407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.589712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7ebe5-51f9-442d-8a59-074f9887c849 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.601581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.602374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.602665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.602944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.604072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.604393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.607958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.608815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.612243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.626995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 199/390] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.631954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.646165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:34.647785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 192/391] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:34.650756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c310df-8256-4515-a634-99afcdc36bac admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.660664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.661719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.662660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.663001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.663327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.677523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb645a-2330-46d1-823f-51aff144f6e1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.685259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.686054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.687355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.689061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.689562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.690029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.690969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.691870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.695037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.723239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 193/392] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.724101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:34.725798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 200/393] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:34.735671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.736819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.740101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c04891-9d6f-46b0-ae95-ccb86c3ea56d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.744583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.745372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.745660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.745937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.747841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9d56e-70b3-469d-9dea-c476537c39d1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.752738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.753425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.753813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.754261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.754745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.755422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.755858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.756328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.758140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5c493-cf23-4a58-81f3-e223b2dda50a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.770702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 201/394] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.771738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:34.772132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363f17-88bd-4a75-8a12-94a503eecea2 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.772427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363f17-88bd-4a75-8a12-94a503eecea2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.772711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5363f17-88bd-4a75-8a12-94a503eecea2 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.773807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 194/395] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:34.776637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.780023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 202/396] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:34 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:34.781168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363f17-88bd-4a75-8a12-94a503eecea2 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.789693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea17d0-7f0c-4c10-9a30-e094938ad315 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.795503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.796681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.797129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.797552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.798423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5363f17-88bd-4a75-8a12-94a503eecea2 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.803218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.804040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.804400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.804751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.805659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.806044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.807874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:34.807874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:34.807874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:34.809192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.809646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.812056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.827602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-054e2158-2462-4ac2-97b8-d76aec1827ac admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 09 04:44:34.829451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 195/397] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:34.829742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 203/398] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.831250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.831850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.832306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.835219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.848991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194d86-54cf-4d83-bac8-3d511cb46ae7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.855101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.856024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.856494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.856970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.857080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:34.858103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.858298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:34.858778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.859991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:34.859991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:34.859991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:34.861489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.867048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 196/399] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:34.868274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.881723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9804d-7d9d-4c97-b149-a436e97dd385 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.886350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.887101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.887492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.887898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.888857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=c16b11a1bbac45c0b869734149bd3416) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:34.889275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.891249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.907272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 197/400] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/role_assignments?user.id=c16b11a1bbac45c0b869734149bd3416&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:34.908406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.909133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 204/401] 10.222.0.41 () {56 vars in 1158 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:34.915307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.926965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d963430-67f2-432d-892c-00fb1566b86c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.934370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1d18-b753-4200-8550-ddf5f6ee0f67 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:34.937744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd4e18-bd0e-4b67-991c-c8af07538ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.938566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4e18-bd0e-4b67-991c-c8af07538ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.938848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4e18-bd0e-4b67-991c-c8af07538ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.939121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd4e18-bd0e-4b67-991c-c8af07538ecc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.947427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:34.948130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.948411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.948686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.961963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd4e18-bd0e-4b67-991c-c8af07538ecc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:34.963136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:34.965236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:34.969842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5bcd4e18-bd0e-4b67-991c-c8af07538ecc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:34.971103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 198/402] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:34.972401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d9ba2-7d2b-4314-975e-f68fadc399ae None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.972685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d9ba2-7d2b-4314-975e-f68fadc399ae None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.972957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d9ba2-7d2b-4314-975e-f68fadc399ae None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.979655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 199/403] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:34.979787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 205/404] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:34.985210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:34.985562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:34.985769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:34.988254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:34.999227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c0a2-5ed6-4a6a-a4bb-a8b12e92b1e1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.005038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.005733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.006022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.006304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.007075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.007394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.009106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.011151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:35.012859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:35.019201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 206/405] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.020208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.022532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 200/406] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:35.031527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac000ba-d932-4a4f-86ff-1a5571e0974a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.033432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.035309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.036246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.036628 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.036998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.050028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8868a9-611b-4156-9f02-54240ba0e9e1 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.056733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.056913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.057707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.057999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.058337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.059280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.072757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.074665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.080474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:35.081863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 207/407] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.083300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.093829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27345e-4b8d-442e-a84e-0876aff58058 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.095012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:35.096536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 201/408] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.097398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.098856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.099785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.100247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.100631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.108928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9d06c-89ed-4153-bfc2-62d33b623363 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.114475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.115157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:35.115272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.115443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.115760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.116526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.116839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.118506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.124726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:35.126982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 208/409] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.127968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.138648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 202/410] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.139527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.139824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34f19d-73a7-4f6f-a31c-e414bff4209d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.144511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.145552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.145937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.146967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.148199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.148612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.150093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0f9e8-d934-4a7b-8524-1dcb9a08f7a5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.150552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.155569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.156290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.156577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.156854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.157630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.157941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.160210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.164912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 209/411] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.165687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.170902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 203/412] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.171750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.182398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7aad57-cc40-4caa-82c1-70f91092d5f9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.188284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.189311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.189570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.189856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.193181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af39f-da39-4322-826b-ada86f2abe32 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.197900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.198090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.198866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.199139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.199416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.199876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.207875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.209912 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.213616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:35.215081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 210/413] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.215902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.224126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 09 04:44:35.225458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79c5cf-9741-4f02-b1e9-36da59d11ebc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.225707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 204/414] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.226633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.230568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.231344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.231665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.231943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.237028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4124e9-5e41-4703-a39e-b9750b299d0f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.241863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.242479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.242672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.242827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.243015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.244456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.244771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.245005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.245766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:35.245766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:35.245766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:35.246894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.263851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:35.264449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 205/415] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.265052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 211/416] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.265371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.271135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.276754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0d73f-131f-4f53-ac44-61dcdd15a873 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.281413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.282120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.282295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7aa50-ef4d-4e08-b8de-2b2370003257 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.282463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.282714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.283896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.284160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.286083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.286615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.287262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.287551 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.288049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.289605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.289928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.292120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.305437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 212/417] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.308429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.314443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 206/418] 10.222.0.41 () {56 vars in 1160 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.315140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.321488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9098f-3e61-48fb-b9d5-30b0a1a0d99d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.326319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f24f9-d1e7-4dc4-b7e3-d23b2644c7b8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.327737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.328547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.328938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.329313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.330254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=0cef991f3ef34b09ad2251ef7e416a91) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.330670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.331048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.331898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.332230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.332503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.332665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.340187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 213/419] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/role_assignments?user.id=0cef991f3ef34b09ad2251ef7e416a91&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.341445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.341704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.343832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.364179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2190-d346-41d8-ae7b-7831e941d018 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.366341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 09 04:44:35.369197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 207/420] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.372602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.373418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.373672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.373950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.375689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.391915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.394072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.397336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca3355-daf7-47f4-bfc1-9ef507edf1e9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.408372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.409057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.409863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.410919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.412119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.412433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.417872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.418449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 214/421] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:35.424981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.439869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b6d37-601e-4e46-8fa8-b7bba84f1ab0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.451119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.452110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.452337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.452566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.455496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 208/422] 10.222.0.41 () {56 vars in 1158 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.462576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.476748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e52dd-b818-435d-a191-5c4fce993d21 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.477111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.479425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.487125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.487946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.488171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.488433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.511683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.515031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.518941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:35.520496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 215/423] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:35.526390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.533127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 209/424] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:35.542618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0ddf4-9969-470a-9625-f45d50072055 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.546456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.560914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.561608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.562276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28804a-2c54-4715-93d5-7e1895b73c90 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.563167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.563523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.564352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.565071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.567014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.573637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.574511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.574796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.575073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.591756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 216/425] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:35.597849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.597989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.600287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.608726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46764112-305c-4c2b-96d9-5be8c4b8f85f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.617774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.618798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.619282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.619570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:35.619967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.623021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 210/426] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:35.627223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.633174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.635517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.645469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71569879-171f-4ca7-b2c4-0429fa2171d3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.649082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:35.651062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 217/427] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:35.655730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.655730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.655730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.655730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.656058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.656058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.656058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.658076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.669379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd9496-32d9-4443-b61d-786ea412a71f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.676958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 211/428] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:35.683128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.688308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.689226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.689712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.690185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.691194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.691761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.693621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea8021-025e-4da9-a380-b7f292a13365 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.693991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3175a2-2b32-4e40-a882-b60fb9131672 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.698352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.699186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.699478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.699891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.706934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 218/429] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.707316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.709330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.713135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea43a0-b107-49b4-be6a-100b624db5ce None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.713426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea43a0-b107-49b4-be6a-100b624db5ce None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.713704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ea43a0-b107-49b4-be6a-100b624db5ce None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.716567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 219/430] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:35 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:35.717358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea43a0-b107-49b4-be6a-100b624db5ce None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.732223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-2ff096f2-3d4d-4654-ba05-e411e8e08361 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:35.734003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 212/431] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:35.734106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ea43a0-b107-49b4-be6a-100b624db5ce None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.735457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.735968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.736465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.745095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.745737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.746029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.746312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.747170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=91a0c407ceb84296be75ad28880f64cb) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.747489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.749387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.756113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 220/432] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/role_assignments?user.id=91a0c407ceb84296be75ad28880f64cb&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.756990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.757784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:35.759277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:35.766986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14df51-a3cc-4df6-abd9-91b4bc9da8cd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.768439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 213/433] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:35.774776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.776135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.776474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.776799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.777667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.778032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.780030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.794408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 221/434] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.797325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.801805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.807177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720810e-2251-4ea8-81f2-c12fcdcc8b53 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.812152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.813244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.813722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.813822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a8b04-7114-404c-9a03-dc8f93fdf992 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.814303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.818962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.819652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.819933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.820217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.821087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=e261119c7a194c7e814a9dfbf6a4b10f) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.821399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.823328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.827646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.829729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.831352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 222/435] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/role_assignments?user.id=e261119c7a194c7e814a9dfbf6a4b10f&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:35.860972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:35.862699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 214/436] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:35.869513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.888118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac5151-ccce-481b-bfe9-bc73953288b0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.902055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.902753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.903043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.903324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.904107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:35.904420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.906059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b9ed5-7127-4c4a-a319-07b83089eceb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:35.927324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 223/437] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:35.934298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:35.949640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5cd66-ecee-4d60-8e47-9f1036187536 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:35.960041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e1d60-c30a-43c8-bb3c-6c0157e09028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:35.961162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1d60-c30a-43c8-bb3c-6c0157e09028 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:35.961638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1d60-c30a-43c8-bb3c-6c0157e09028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:35.962104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e1d60-c30a-43c8-bb3c-6c0157e09028 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:35.963612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e1d60-c30a-43c8-bb3c-6c0157e09028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:35.965855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e1d60-c30a-43c8-bb3c-6c0157e09028 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:36.011482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 215/438] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:35 2021] POST /identity/v3/users => generated 247 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:37.786705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072807-ceb1-4aa8-b90c-2e905951ac95 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.787244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072807-ceb1-4aa8-b90c-2e905951ac95 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.787244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b072807-ceb1-4aa8-b90c-2e905951ac95 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.789362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 224/439] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:37.795874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.796279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.796459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.820746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:37.821902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:37.829947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 216/440] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:37.854608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b072807-ceb1-4aa8-b90c-2e905951ac95 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:37.875187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b072807-ceb1-4aa8-b90c-2e905951ac95 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:37.882025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:37.882814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.883098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.883376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.896708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:37.907689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:37.909216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 225/441] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:37.915196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:37.925041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c660f4-ce88-49a9-a1b5-82713b0e488e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:37.937156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:37.937828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.938110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.938382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.939150 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:37.939453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:37.941098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c85a28-fa97-4625-855f-f1d5d8ceacf8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:37.949895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 217/442] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:37.955889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:37.968618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece82f5-e73d-4f5a-8fd7-7783d1039044 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:37.975798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:37.976626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.976922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.977206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.985532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cd34a-4fa4-4c67-a91f-274f64276556 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.986258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cd34a-4fa4-4c67-a91f-274f64276556 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.986741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cd34a-4fa4-4c67-a91f-274f64276556 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.988925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 218/443] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:37.995440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:37.996038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:37.996531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:37.999861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.002795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.034060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:38.035279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 226/444] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.036397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:38.037609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:38.044643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.048276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 219/445] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:37 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:38.060661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36a93c-c033-412e-877b-f25c1c958cf7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.073383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.073536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.074066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.074354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.074639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.075394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.075724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.077350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.082446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05db45-5fae-4e3f-bf2c-239e072b82d8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.088071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.088865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.089145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.089417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.098183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 227/446] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.105235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.107848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:38.115062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:38.116604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 220/447] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:38.123698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.130724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e2121-cc99-4821-9ebf-b44900cabc10 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.133594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5adfc20-3ce0-4e7a-9f41-42e9b3297177 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.138231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.142959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.142959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.142959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.142959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.142959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.142959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.147922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.148790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.149481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.150284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.157172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 221/448] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:38.163844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.172831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.174922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.182321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ea9e-839d-4dad-b9d0-432a343585e6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.191869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.192914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.193332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.195900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.205414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:44:38.206633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 228/449] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.219394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.220809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.222677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.229228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af12bc-b64d-41e8-8594-ac60a51010f0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.233612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.234258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.234540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.234817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.235761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.236071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.237947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.254824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:38.259646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 229/450] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.260408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 222/451] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.264614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.268045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.286430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881b4eb-ec39-4392-9b5c-210b0220ba2b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.289763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d11e5-7375-4466-a65a-a39b34d2edfd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.296511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.298289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.298941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.299223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.299861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.300142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.300413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.301416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.302619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.305358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.309275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.324608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.326365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.333735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 223/452] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.340387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.353135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094582e1-8972-4af0-92dd-dff026ad9408 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.357953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.358827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.359115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.359485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.363434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:38.364906 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 230/453] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.371698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.373042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.375360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.391204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 09 04:44:38.393169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 224/454] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/users/glance => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:38.396499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75208055-0c31-4594-9c6f-dcceb75f685c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.401216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.401895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.402797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.403273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.403796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.404833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.405347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.407223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.425177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d1749-9346-4ec2-901a-fea4778b6a35 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.425518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 231/455] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.427767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.438126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028ebeb-5d76-4a91-8e9e-bc0662049d93 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.443073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692357b-fad6-4751-8228-29685843192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.444276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.444398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692357b-fad6-4751-8228-29685843192f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.444894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692357b-fad6-4751-8228-29685843192f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.444993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.445207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.445479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.445915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692357b-fad6-4751-8228-29685843192f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.446327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.447164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.449051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.454437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692357b-fad6-4751-8228-29685843192f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.456911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692357b-fad6-4751-8228-29685843192f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.471874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-d692357b-fad6-4751-8228-29685843192f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:38.478102 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 232/456] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.480140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692357b-fad6-4751-8228-29685843192f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.484058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 225/457] 10.222.0.41 () {56 vars in 1158 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.489618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.495213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692357b-fad6-4751-8228-29685843192f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.502622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.503552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.504228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.504696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.505207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b42e25-f734-49d1-ac45-97bbff89716f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.506028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.506579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.508905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a498d-92e7-45fe-8ab2-d481a5d25493 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.521636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.522574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.522681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 233/458] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:38.522758 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.523373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.524141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc3026-d19d-416c-89f6-213e27667c46 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.524141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc3026-d19d-416c-89f6-213e27667c46 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.524456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc3026-d19d-416c-89f6-213e27667c46 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.526927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 234/459] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:38.533203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.533596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.534007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.540234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.542257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.556805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:38.558070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:38.566414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:38.567725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 235/461] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:38.567952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 226/461] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:38.568946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.575035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.582418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee64380-7d29-4ccc-b956-4185837c23fc admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.586888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.587428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8668a2-f81e-451a-9224-e72ef0c6f51b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.588391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.588673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.589041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/c16b11a1bbac45c0b869734149bd3416/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.594675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.595575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.596086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.596576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.597507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.598443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.600547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.610461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=c16b11a1bbac45c0b869734149bd3416, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.613107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 236/462] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.614077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.619358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.629675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 227/463] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:38 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/c16b11a1bbac45c0b869734149bd3416/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:38.630159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bdfe1-25e6-4bf2-806f-11c7ba31d1f7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.630801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.692570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.693807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.694281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.694773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.704126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.706658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.716468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a3fcc-390a-4ae9-8eab-7a8515b56740 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.721048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.722008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.722366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.722695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.723211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:38.724812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 237/464] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:38.734882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.739213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:38.747432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:38.748924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 228/465] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.755098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.756609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e98a7a-06ec-48c8-b969-339434b7f966 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.766726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70ee13-284e-463a-8b7f-22a43da38f3a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.769045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.769950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.770439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.770885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.771910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.772383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.772580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.773287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.773635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.773982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.774921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.775341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.775734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.783687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.788224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 229/466] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:38.794563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.798267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 238/467] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.804685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.805343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d033f-8731-4913-9dc5-8ae3550d4c3e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.810669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.811699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.811843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.812059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.824344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.825346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4b5d9-7a20-4c71-849d-331ddf23751e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.826265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.832436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ccf05-f750-4522-9cc1-f803b79c3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.833719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccf05-f750-4522-9cc1-f803b79c3e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.834237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccf05-f750-4522-9cc1-f803b79c3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.834719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ccf05-f750-4522-9cc1-f803b79c3e53 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/0cef991f3ef34b09ad2251ef7e416a91/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.844927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-314acb09-ed38-4978-930f-a3b92e9bb2f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:38.851084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 230/468] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:38.852785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40291-6f42-4ac0-964d-6b62129a7c05 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.852950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ccf05-f750-4522-9cc1-f803b79c3e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=0cef991f3ef34b09ad2251ef7e416a91, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.853130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40291-6f42-4ac0-964d-6b62129a7c05 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.853374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c40291-6f42-4ac0-964d-6b62129a7c05 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.855325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 231/469] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:38.859691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40291-6f42-4ac0-964d-6b62129a7c05 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:38.862010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ccf05-f750-4522-9cc1-f803b79c3e53 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.874355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c40291-6f42-4ac0-964d-6b62129a7c05 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:38.879720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 239/470] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:38 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/0cef991f3ef34b09ad2251ef7e416a91/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:38.883097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.883378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.883674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.904563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:38.906183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:38.955958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:38.957613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:38.958325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:38.958944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:38.960118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:38.960984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:38.963216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:38.973542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 240/471] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:38.983109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 232/472] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:38.990122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.001731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400280c-5183-4e3c-911f-1e1e4e2be118 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.006713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.007809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.008230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.008514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.009769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.017006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.019429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.025667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca62e7a-0e1e-4989-994e-e00dde0c30d5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.031056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.032270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.032779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.033324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.034309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 09 04:44:39.035956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 241/473] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:38 2021] GET /identity/v3/users/neutron => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.042984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.059980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:39.061977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8301-02fa-41e9-a04b-91c60de65078 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.067683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:39.069645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 233/474] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.072497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.073432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.073935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.074407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.075910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.077128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.082515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.084788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.097244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b70e7-6bac-4aa9-88ee-7faf0fbd78b1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.112359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.113399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.113902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.114423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.115425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.115948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.117787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.124553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 242/475] 10.222.0.41 () {56 vars in 1160 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:39.130680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.134519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 234/476] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:39.141064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.142315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd77bc-c148-41f8-bdc8-db41da7e1a01 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.147437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.148670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.149164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.149644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.153488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa5f0a-99e1-4541-b3b1-92cd74b97c39 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.162080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.162771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.166013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.166013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.166013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.167781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.180566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.183304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.189042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:39.190891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 243/477] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:39.196931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.205339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:39.206920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 235/478] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:39.207534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd63c05-a86e-4621-9fd0-4f6245002514 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.213221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.223746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.223746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.223746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.224034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.224773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.225078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.226684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.233779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ceb7-6517-4028-a36e-da702afd8e26 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.238472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.239353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.239909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.240149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 244/479] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:39.240597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.241472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.241906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.244248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.246676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.256914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64c7df-a54a-4b5e-b9ce-0d70b993911f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.257383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 236/480] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:39.262842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.266346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.267135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.267418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.267734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.275358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.277343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.289851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b3bcef-ef09-4b36-9b05-318b771b9f3e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.291223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:39.292406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 245/481] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.298739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.310245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79840a-67c4-4b02-bbf1-832137b78755 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.315043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.315792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.316106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.316232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.316513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.316913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.317190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.317461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.317562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.317885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.319807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50d662-26d6-48eb-8ed6-2b65c96fefdb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.325887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.328070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.331801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 246/482] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:39.333136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f97b9-a562-432c-95e1-85afab3504ba None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.339173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f97b9-a562-432c-95e1-85afab3504ba None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.339537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f97b9-a562-432c-95e1-85afab3504ba None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.341550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 247/483] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:39 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:39.342298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f97b9-a562-432c-95e1-85afab3504ba None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.347313 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-c336e8e3-af78-498b-8801-46ec9fa3acf1 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 09 04:44:39.349249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 237/484] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/users/cinder => generated 84 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.350497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.350782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.351059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.369092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f97b9-a562-432c-95e1-85afab3504ba None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.369284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:39.370449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:39.374805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.375957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.376310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.376697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/91a0c407ceb84296be75ad28880f64cb/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.387729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 238/485] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:39.388576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.398439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=91a0c407ceb84296be75ad28880f64cb, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.403594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d96c38-5a00-426d-a4ae-d850bc6a267c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.405644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.412089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.413296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.413767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.414189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.415124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.416249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.418352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.423966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 248/486] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:39 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/91a0c407ceb84296be75ad28880f64cb/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:39.425152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.458543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 239/487] 10.222.0.41 () {56 vars in 1158 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:39.464771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.483300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e74db2-d913-4fc9-870f-53b9f1eb2c3d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.502149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fade26a6-3c05-4341-9e2f-a1f1f8ff5858 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.507702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.509654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.510174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.510689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.523554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:39.532529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:39.534628 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 249/488] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.548380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.559906 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60325386-1ce6-4314-93cf-0f4041cde3ff admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.565158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.566253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.566743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.567212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.568748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.569261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.571167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.583253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 250/489] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:39.593273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.614118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b59fb5-3a61-420b-b908-7ba545695607 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.619707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.620522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.621328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.621602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.624871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.625668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.626891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.628375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.645929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.647897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.651111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.652972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.685426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:39.686975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 251/490] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.687930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:39.689195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 240/491] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.697790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.700724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.709574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4ece3-c6db-453d-9fbd-65cb3d27c973 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.715645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.716375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.716659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.716988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.717352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f3429-5169-43e0-944a-487eee0790b5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.717744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.718053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.719674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.735038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.735697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.735988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.736311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.737067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.737376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.738968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.739357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 252/492] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:39.740357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.756759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42338c10-bec8-44e7-ab58-08c0363e7380 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.759827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 241/493] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:39.765888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.766743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.768022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.768536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.769006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.778697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680659c1-74f6-401c-9d55-9658d842d4a7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.780368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.782800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.784925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.785270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.785625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.785979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.794648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.797231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.801715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:39.807358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 253/494] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:39.810435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.815241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 09 04:44:39.816849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 242/495] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:39.821088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ae8e6d-80ac-4913-a8bf-71dd7165288c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.823396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.827459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.828446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.829081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.829581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.831154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.832583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.833706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743a265-cd03-45b1-b4d3-ed8a00c81675 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.834986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.839299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.840065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.840508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.840898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.841820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:39.842292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.844330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.851892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 254/496] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:39.860048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.866928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 243/497] 10.222.0.41 () {56 vars in 1156 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:39.871239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f7306-306d-4d9c-9a57-3003ffbed35c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.873046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:39.876365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.877831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.878344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.878836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/e261119c7a194c7e814a9dfbf6a4b10f/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.896561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=e261119c7a194c7e814a9dfbf6a4b10f, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.898009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef9e85-eeb3-4bdf-9f85-6e5486a4b201 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:39.900455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.913261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:39.913920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:39.914207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:39.914502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:39.916879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 255/498] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:39 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/e261119c7a194c7e814a9dfbf6a4b10f/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:44:39.941034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:39.942859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:39.963897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 244/499] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:39.970341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:40.037283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b71a7-466d-4673-b8f8-f7bf55587b9e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:40.042041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:40.042943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:40.043237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:40.043517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:40.055322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:40.057388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:40.076598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:40.077872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 256/500] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:40.084591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:40.094609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3c6e2-3f05-4d45-8369-eee6e2b4c2e2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:40.099531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:40.100259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:40.100601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:40.100887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:40.101647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:40.101956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:40.103870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:40.116952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 245/501] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:40.123988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:40.135305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905b0ac-fc17-42b7-8ef4-87245943e9a3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:40.140266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:40.141133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:40.141424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:40.141706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:40.150143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:40.152282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:40.171887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:40.173321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 257/502] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:40.179782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:40.196548 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07286c-55c5-483e-9c29-42bda05eefd2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:40.204000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:40.204717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:40.205006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:40.205287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:40.206147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:40.206464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:40.208500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1771f12-981d-48be-928c-8c7b9e0a4e8f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:40.222320 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 246/503] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:40.229710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:40.240567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe25cc-ae7e-4194-9a71-465495c049eb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:40.245790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:40.246494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:40.246830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:40.247114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:40.248053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=b400457cc4a343f6a25e43f6d24edc42) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:40.248381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:40.250298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08b38b-4d59-4aec-b848-e0b83b30c7f7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:40.256703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 258/504] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:40 2021] GET /identity/v3/role_assignments?user.id=b400457cc4a343f6a25e43f6d24edc42&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:41.444789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e5182-d822-4801-b9b1-aa49ccf7bf15 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.445306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e5182-d822-4801-b9b1-aa49ccf7bf15 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.445377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e5182-d822-4801-b9b1-aa49ccf7bf15 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.448048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 247/505] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:41.454622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.455055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.455234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.485706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:41.487583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:41.505876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 259/506] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:41.548722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e5182-d822-4801-b9b1-aa49ccf7bf15 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:41.567361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e5182-d822-4801-b9b1-aa49ccf7bf15 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:41.575092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:41.576164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.576662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.577140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.602918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:41.613405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:41.614621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 248/507] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:41.622283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:41.641901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8f714-f614-4ce1-8d88-ea84d2b138b7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:41.662235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:41.663415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.663977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.664380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.665348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:41.665902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:41.668310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:41.684072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 260/508] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:41.691062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:41.710685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b976de-adcc-4169-89d8-025fcc4f5a4d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:41.722674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:41.723481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.723793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.724076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.746177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:41.748067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:41.770054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:41.772270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 249/509] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:41.778105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:41.800563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932835f1-242e-4123-90ec-6f1baa728561 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:41.805202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:41.806400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.806699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.807297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.808671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:41.809202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:41.811542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:41.838062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 261/510] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:41.844372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:41.858695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688eab-205c-41a4-a044-9997b6dab125 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:41.867676 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:41.869013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.869300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.869578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.880874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:41.883218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:41.898250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ec25222b-35d9-4e4a-8f5b-0665b09bfa8a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:44:41.899453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 250/511] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:41.909304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:41.930373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebfae8-4c79-4244-add6-c5e812579592 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:41.939611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:41.940319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.940608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.940889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.941823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:41.942155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:41.944828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:41.973797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfae25-a37d-49d2-b843-a3ba39172845 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.974080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfae25-a37d-49d2-b843-a3ba39172845 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.974275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfae25-a37d-49d2-b843-a3ba39172845 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.976173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 251/512] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:41.979363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 262/513] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:41.986315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:41.986315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:41.986315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:41.995219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.020501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:42.020501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:42.025261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ae50-4d3b-4867-ad8b-fb74ebb83095 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.036534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.037887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.038117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 252/514] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:42.038300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.038578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.048336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.050205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.062445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 263/515] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:44:42.068400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.082307 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8dd7e-1831-495b-b220-68e2e5da6d23 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.088403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.102287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.103947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.104248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.104510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.105795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec850b-9796-4c3f-9a4c-2c2fa9f6da0a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.117493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.118520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.119319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.119599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.126137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.128043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.134245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:42.141890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:42.143407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 264/516] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:42.150252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.156913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:42.159976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e38769-b4af-4526-891b-f8439928c6e1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.163842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 253/517] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.164677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.164852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.165926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.166272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.166552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.167371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.167713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.169418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.179604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 265/518] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:42.186898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.187133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22505562-f6b5-4a9e-ba22-84b539c956e3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.201216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.201944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.202229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.202565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.203311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.204165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.207806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.209849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab694d-8575-473a-a8d3-5e15df8a3d71 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.221748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.222601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.222889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.223167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.235303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 254/519] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:42.237400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.239368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.241481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.258167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ef7df-43c1-4fa4-836c-8ab1e9832c79 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.269701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.270542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.270826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.271107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.277466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:42.282194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 266/520] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.283231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.285358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.292453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.309535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7067724-d65f-4e9c-974f-08c075ff571c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.320873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.321621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.321966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.322299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.323060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.323374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.325842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:42.326941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.330107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 255/521] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.340734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.347492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 267/522] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:42.354424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.357247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c74ecd-22d3-4c36-99c8-254b482de7c1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.361961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.362643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.362929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.363207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.364058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.364369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.366230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.369632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553f6c6-66b3-44b2-b8be-0eae14e24e9e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.377038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.378120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.378622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.378736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 256/523] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:42.380684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.386064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.398254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.402804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6155f-164d-4b4d-abc6-309a1c0dff01 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.403732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.413813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.414472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.414807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.415091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.418009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=c16b11a1bbac45c0b869734149bd3416) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.420330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.424496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.428382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 09 04:44:42.429713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 268/524] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/users/glance => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:42.438130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.442399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 257/525] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/role_assignments?user.id=c16b11a1bbac45c0b869734149bd3416&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:42.449854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650e609-4275-4119-a990-412d831fe587 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.454810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.455552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.455886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.456172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.457188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.457502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.459635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee623237-d7f9-4a7f-a420-e67a7d34b5d4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.491789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 269/526] 10.222.0.41 () {56 vars in 1158 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:42.497967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.508688 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a831ad-c801-482a-9d5e-5a608015e0fa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.512392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355acd-c0f9-4e9e-a780-900bc2f15abd None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.512736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355acd-c0f9-4e9e-a780-900bc2f15abd None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.513021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89355acd-c0f9-4e9e-a780-900bc2f15abd None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.514897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 270/527] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:42.522372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.522681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.523187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.523377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.523765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.524050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.524290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.533936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.535735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.546842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 258/528] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:42.553126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.562687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba0e2d-a88a-4a10-b12e-85435b9cb7e8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.564433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:42.566226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:42.567553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.574580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.574580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.574580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.588672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 271/529] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:42.592479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.594464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.612637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:42.614180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 259/530] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:42.620484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.630346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d259ec-2f3d-43ef-bea7-67a54ecaa660 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.632080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.644357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.645041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.645379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.645663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.646494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.646810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.651491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750d63-4863-4385-9bc8-1fb3ee1e55c5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.652912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.662465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.664570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.664940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.665252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.678970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 272/531] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:42.689617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.700432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:42.709900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f5721-2728-45fb-a19c-c7ec3fa51525 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.713122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:42.714558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 260/532] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.718080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.718881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.719165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.719443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.722587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.735655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.737827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.741268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae05f1b-ee8c-4a98-b6bc-4a1789476ed3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.750791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.751397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.751712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.751993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.752770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.752986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:42.753157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.754609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 273/533] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.754792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.762376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.773647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c9ab-4ee6-4c6a-b774-f7b070346cc1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.779798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 261/534] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:42.784939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.785852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.786027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.786280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.786742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.787202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.787522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.789583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.800799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5944a-5143-4d06-89bc-48ad1e02a818 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.805971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 274/535] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:42.812495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.814495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.816165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.816703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.817076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.824326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9f466-18e7-45bd-8bc4-e4c925253188 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.829466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.830321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.830714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.831104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.832186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=0cef991f3ef34b09ad2251ef7e416a91) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.832304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.832688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.834254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.834471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44f3de-4166-4b81-8469-af41b4ca7710 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.843189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 275/536] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/role_assignments?user.id=0cef991f3ef34b09ad2251ef7e416a91&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:42.844318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4256-10f8-4b9d-9d05-48d1eb7ce783 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.844739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4256-10f8-4b9d-9d05-48d1eb7ce783 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.845230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c4256-10f8-4b9d-9d05-48d1eb7ce783 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.846650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 276/537] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:42.853408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.853724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.854005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.854321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:42.855714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 262/538] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:42.862030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.872029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17e5c1-15c7-4b95-8030-1512d591f4d3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.873697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:42.875185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:42.877029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.877807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.878194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.878563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.879421 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.879914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.881771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.891779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 277/539] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:42.895806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 263/540] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:42.902847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.916805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.917565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad8c4f-749b-445c-8d09-05275a74483b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.922622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.923575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.923861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.924192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.932383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de6408-574e-4929-ab05-cce5eb63e3ee admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.935062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.937994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de9216-bdb5-4f23-ba50-6e53220c4813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.938343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:42.939308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9216-bdb5-4f23-ba50-6e53220c4813 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.939847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9216-bdb5-4f23-ba50-6e53220c4813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.940299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de9216-bdb5-4f23-ba50-6e53220c4813 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.957284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de9216-bdb5-4f23-ba50-6e53220c4813 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:42.959293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-0031fa5e-7c92-405f-a3bd-1b487d8eefed admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 09 04:44:42.960855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 278/541] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.967176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022de7c0-22a1-4a75-9662-97a422fecf78 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.967495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022de7c0-22a1-4a75-9662-97a422fecf78 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.967922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022de7c0-22a1-4a75-9662-97a422fecf78 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.969825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 279/542] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:42.970678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022de7c0-22a1-4a75-9662-97a422fecf78 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:42.972966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-e4de9216-bdb5-4f23-ba50-6e53220c4813 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:42.975347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 264/543] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:42.978030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.978440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.978816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.985508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022de7c0-22a1-4a75-9662-97a422fecf78 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:42.990861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:42.992151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:42.992670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:42.992950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:42.993939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:42.994250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:42.996289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.001192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:43.002475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:43.011610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 265/544] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:43.012753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.019459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 280/545] 10.222.0.41 () {56 vars in 1160 bytes} [Tue Nov 9 04:44:42 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.026522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.029932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9044fb-ee0d-4c4d-ac3c-646917eaa1a8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.036880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.037203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16011-f3a0-42c4-b646-cf187eda141c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.038118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.038659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.039246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.040403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.040957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.043852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.044213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.045230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.045524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.045802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.055390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 266/546] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.055583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.056670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.057491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.068606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 281/547] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:43.073320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.073846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9788ebb-e413-44ce-9bf4-609eeb576f24 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.078423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.079467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.079584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.079819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.086664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33509094-33ae-430c-b9ba-5f489e1a5b36 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.091560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:43.091823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.092608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.092890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.093165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.098510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:43.099935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 267/548] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.100497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.108954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.110820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.118174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9156b-88c4-40d4-8eb9-6d08bdb65dcc admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.123094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.123938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.124223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.124494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.135315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:43.136410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.136779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 282/549] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:43.138379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.140238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.151846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd742f29-867d-444f-ab48-f5d4816bc28c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.156361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:43.156767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.157733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.157865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 268/550] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.157954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.158197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.159094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.159460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.160480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.161256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.173026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 283/551] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.173690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770047c-940e-46ca-9a4d-32fbb6ced8a6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.173916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.179311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.180016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.180298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.180574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.181864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.182172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.184549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.193227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0911b-3201-4493-a48b-da231159ee05 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.199476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.199637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 269/552] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.200345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.200461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.200845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.201171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.202013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.202421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.204142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.210834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b035b1-1105-4769-b76a-edb6b977ff17 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.217036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.217821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.218104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.218485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 284/553] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.218595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.219323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.230447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407607d0-7c22-45c0-bf4a-2fed7cf0f032 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.234973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.235469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.235984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.236381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.236750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.237379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.245640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.247806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.255579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:43.257084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 270/554] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.257871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.267773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 09 04:44:43.268003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea3c22-4ed9-41b7-9a32-3d97a4c55b1b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.269461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 285/555] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.270316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.272730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.273547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.273829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.274104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.281443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.283043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a59972-bed1-4aa8-b7c8-bcd478cd9e41 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.283732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.287776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.288586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.289010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.289469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.290452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.290912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.292568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.299374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:43.301231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 271/556] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.302262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.310856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 286/557] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.311641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.321163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb12c3a-7216-4fd9-b12b-c8b4fc6582d7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.323490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d39bf-92c8-45fc-8b78-539319e07777 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.326536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.327344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.327819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.328242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.329147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.329394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.329846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.330140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.330515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.330918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.331967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.332388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.332692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.334831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.346007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 287/558] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.351707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.360267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 272/559] 10.222.0.41 () {56 vars in 1158 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.361398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.362770 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e7683-4ed0-4e64-a909-cc2982f8a802 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.367762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.369281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.369655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.370021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.372297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed415d-25b7-446b-8b81-50298ae2ecb9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.376990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.377769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.378193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.378445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.378774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.379790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=91a0c407ceb84296be75ad28880f64cb) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.380239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.381011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.382346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.395790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 273/560] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/role_assignments?user.id=91a0c407ceb84296be75ad28880f64cb&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.396350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 09 04:44:43.397206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.397863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 288/561] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/users/swift => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.406177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.414172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fee76-8d5d-4d86-8f0b-56be72dd7ee5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.418551 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1818f-a993-42d4-a935-787f2fe5cee2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.423652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.424013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.424583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.424960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.425125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.425496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.425679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.426086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.426694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.431646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.431646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.443356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.445395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.455783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 289/562] 10.222.0.41 () {56 vars in 1156 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:43.458198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.466511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 274/563] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:43.468890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a6d8ea-43f9-46b8-adaf-c4ab2fe7d677 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.473201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.474339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.475287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.475745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.476198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.488175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.490209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.491685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79029098-4e67-41d6-961a-77df80300a87 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.505386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.506904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.507323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.507788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.512714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:43.512714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 290/564] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.519144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.531487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2f22d-8fd5-4562-a188-c30dada42203 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.534870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.538348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.541452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.542130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.543780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.544103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.545943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.546297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.558213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.586481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 291/565] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.591963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:43.593632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 275/566] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:43.596128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.600522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.613252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e326cb-6446-48d6-99e8-3261adf44783 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.621645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c18c-a2b0-4f7b-aacd-a78a58b0418a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.625276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.626684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.626969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.627827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.630621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.633046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.633360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.633646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.634540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.634850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.636502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.638398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.640541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.655329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:43.656903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 292/567] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:43.657683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 276/568] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.663369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.663527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.675509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78685534-9e18-4772-a066-e6be1e3e346b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.678322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb9d6-46af-4e1b-8178-4cb7e964a21e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.680350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.682253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.682539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.682859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.684230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.684541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.688410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.689273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.689553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.689884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.690450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.701003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.702253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.709990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 293/569] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.716281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.723492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:43.725260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 277/570] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:43.731977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.732521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab0bc2-b919-4d92-a183-69c481eb8778 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.740830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aaf59-95ff-460f-bb5c-702814d86239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.742023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aaf59-95ff-460f-bb5c-702814d86239 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.742481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aaf59-95ff-460f-bb5c-702814d86239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.743006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aaf59-95ff-460f-bb5c-702814d86239 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/b400457cc4a343f6a25e43f6d24edc42/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.745337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99125390-0ec0-4cc4-9d8c-3d0cdac2f660 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.758519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.759197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.759477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.760005 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.760825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.761141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.762984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.764313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aaf59-95ff-460f-bb5c-702814d86239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=b400457cc4a343f6a25e43f6d24edc42, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.767373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aaf59-95ff-460f-bb5c-702814d86239 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.776828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 278/571] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:43.783555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:43.785960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 294/572] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:43 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/b400457cc4a343f6a25e43f6d24edc42/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:44:43.797027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531873-ceab-414d-8f5a-4664b6ad3406 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:43.862094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:43.862762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:43.863049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:43.863328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:43.864328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=e261119c7a194c7e814a9dfbf6a4b10f) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:43.864649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:43.866545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24407a6-898c-4e96-a3b8-884b0e23d3b8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:43.873224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 279/573] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:43 2021] GET /identity/v3/role_assignments?user.id=e261119c7a194c7e814a9dfbf6a4b10f&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:45.335802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0162-8fbe-4f8b-9975-807052d86546 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.336856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0162-8fbe-4f8b-9975-807052d86546 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.337873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d0162-8fbe-4f8b-9975-807052d86546 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.340155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 295/574] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:45.345955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.346839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.347340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.372901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:45.374458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:45.383874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 280/575] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:45.408428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0162-8fbe-4f8b-9975-807052d86546 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.421891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d0162-8fbe-4f8b-9975-807052d86546 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.431736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.432811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.433303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.433781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.452441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:45.459865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:45.461426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 296/576] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:45.468524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.478514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df62651-6e73-4a2b-92b2-7c9bfc5b0d95 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.488185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.488888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.489174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.489461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.490262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:45.490575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.492287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.508502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 281/577] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:45.514775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.525348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bdefa5-2197-44f9-b29d-8333543d06f5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.531927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.532731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.533019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.533305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.545449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.547286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.563852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:45.565049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 297/578] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:45.572385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.582164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bba81-2cff-4810-b9a2-a3e538beaae4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.586764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.587937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.588223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.588503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.589247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:45.589558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.591153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.613858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 282/579] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:45.619919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.632593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3014a1-03d2-4acc-9778-d06e8a13b0d3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.642179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.642975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.643262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.643544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.656786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.658833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.675338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:44:45.676574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 298/580] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:45.682768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.697093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69a1b2-4260-49aa-9157-64c8aa8ec92b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.705597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.706265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.706545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.706817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.707698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:45.708009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.709842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5d87a-c1ba-4ca6-bba5-f8907e02ab69 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.735986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 283/581] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:45.741863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.751716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda65cd7-39cb-45cf-8d0d-57b2d0c64318 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.754974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f3788-9da8-42a6-ac9e-e2f72e90ad23 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.755265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f3788-9da8-42a6-ac9e-e2f72e90ad23 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.755549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f3788-9da8-42a6-ac9e-e2f72e90ad23 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.757343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 284/582] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:45.760775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.761418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.761702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.761983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.764915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.765203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.765483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.778679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.780481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.789802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 299/583] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:45.796053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.796254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:45.797246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:45.804608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a797b7-7ebe-41be-8cd3-b16ddfde32a0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.809136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.809914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.810203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.810486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.815915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 285/584] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:45.821976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.823912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.841369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:45.842676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 300/585] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:45.848652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.853485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.865203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db43ab-7b49-4fd5-bd7c-e89c2aec04b7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.867815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac88573-2a65-4065-9501-fc1fec04b01e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.875029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.875724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.876014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.876295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.877039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:45.877348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.878934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.880912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.881677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.881962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.882242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.901832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 286/586] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:45.902526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.904474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.916593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.928099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:45.929359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 301/587] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:45.934859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf9620-0256-4032-8db8-3bb44596a975 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.938449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:45.940903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.941700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.941984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.942268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.955771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.957741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.960415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92579b1-6b82-46e1-bbb8-df7baa89e533 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:45.975389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:45.978166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:45.978832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:45.979115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:45.979391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:45.980164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:45.980471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:45.982071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:45.984451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 287/588] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:45.992136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.003380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 302/589] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:46.005736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f77f5-301d-4dfb-9dc1-4e59dd075b37 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.011292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.016519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.017187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.017469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.017747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.018589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:46.018870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.020756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.027935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6861f-68df-450a-b9cf-cb10dd383b5c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.036733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73208b-abd1-4b1d-b2d6-b4e8c4a5977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.037413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73208b-abd1-4b1d-b2d6-b4e8c4a5977d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.037703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73208b-abd1-4b1d-b2d6-b4e8c4a5977d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.038047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73208b-abd1-4b1d-b2d6-b4e8c4a5977d admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.038712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73208b-abd1-4b1d-b2d6-b4e8c4a5977d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.040704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73208b-abd1-4b1d-b2d6-b4e8c4a5977d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.052949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 288/590] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:46.060179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.075245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1a84a-426f-42b7-beb5-801191594c0f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.080341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 303/591] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:44:46 2021] POST /identity/v3/users => generated 254 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:46.083983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.084677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.085022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.085356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.086299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=c16b11a1bbac45c0b869734149bd3416) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:46.086672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.089702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1661f-5a3d-460d-ba2f-453ee282dd9c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.096835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 289/592] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/role_assignments?user.id=c16b11a1bbac45c0b869734149bd3416&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:46.226911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc472-7110-4296-a900-11e76cd55caa None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.227249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc472-7110-4296-a900-11e76cd55caa None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.227473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbc472-7110-4296-a900-11e76cd55caa None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.229608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 304/593] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:46.237212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.237512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.237774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.264890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:46.266126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:46.274573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 290/594] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:46.312808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc472-7110-4296-a900-11e76cd55caa None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.330144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbc472-7110-4296-a900-11e76cd55caa None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.341174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.341999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.342290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.342570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.343260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.344328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:46.344328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:46.344328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:46.345222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.365197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 09 04:44:46.366379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 305/595] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/services/network => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:46.373994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.389798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58175f-e29e-444b-b975-4f84602ac6d6 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.405945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.406641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.406920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.407195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.407960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:46.408263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.409270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:46.409270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:46.409270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:46.410151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1587b9-964d-4322-9d92-eb04aa466b36 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.417604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 291/596] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/services?name=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:46.424600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.436180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b62c5f-2d30-4ea9-8664-3707d384d8f4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.442904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.443577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.443892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.444170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.444898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:46.445263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.446272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:46.446272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:46.446272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:46.447813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fb1bd-61b9-43e0-bd07-ac82564a542b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.455649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 306/597] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:46.734402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89978-d1c1-47c0-b13c-bf4835e2c704 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.734859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89978-d1c1-47c0-b13c-bf4835e2c704 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.735237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89978-d1c1-47c0-b13c-bf4835e2c704 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.737444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 292/598] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:46.744462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.744754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.745037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.766028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:46.767230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:46.775435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 307/599] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:46.801015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89978-d1c1-47c0-b13c-bf4835e2c704 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.814901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89978-d1c1-47c0-b13c-bf4835e2c704 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.819392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.820205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.820489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.820817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.832081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:46.839748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:46.841294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 293/600] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:46.847721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.857426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8cfa9-fb0c-466a-b19d-dc7f234311e8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.862062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.862718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.863004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.863282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.864079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:46.864445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.866142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.878882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 308/601] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:46.884951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.895222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a263d-7f5e-435d-8530-969ad089eb28 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.904223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.905067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.905348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.905683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.919410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.921642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.938106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:46.939571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 294/602] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:46.945869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:46.955780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a5f7c-53c0-4a3a-9945-44b566ddd228 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:46.960465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:46.961116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:46.961455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:46.961740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:46.963051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:46.963360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:46.965032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:46.985303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 309/603] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:46.991427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.001813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df20f9-fa5b-4008-9328-eb5b5ac74b4b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.009454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.010299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.010585 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.010864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.020715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.022833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.041292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 09 04:44:47.042534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 295/604] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:46 2021] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:47.049140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.060636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9dc0f-bed5-408a-b2b3-6cd86d051d63 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.076782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.077755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.078236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.078706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.079804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:47.080308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.082342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.105609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 310/605] 10.222.0.41 () {56 vars in 1156 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:47.114594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.128494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce15ab-ab42-49dd-b9da-1bd512d4f8b4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.136419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.137095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.137472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.137756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.155905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.157688 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.174244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 296/606] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:44:47.180447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.197229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214c5fb-10d4-47aa-a51d-86097eb22e61 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.205087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.206104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.206583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.207067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.222317 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.224455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.241345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:47.243087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 311/607] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:47.252892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.269687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974787-cbb8-42a4-beb0-d94bd1b33e8b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.277099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.277755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.278039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.278317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.279055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:47.279360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.280980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58039b36-1c70-431a-990f-fa48dd124286 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.293278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 297/608] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:47.299608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.309433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce22644-dc0a-4f69-afc2-cc6a326ae9eb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.313971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.314762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.315045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.315324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.323351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.325350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.346828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:47.348114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 312/609] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:47.353798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989969-6f35-4373-9e8f-6063058882ad None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.354089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989969-6f35-4373-9e8f-6063058882ad None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.354368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77989969-6f35-4373-9e8f-6063058882ad None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.356166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 298/610] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:47.358467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.362015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.362302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.362578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.374994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cd068-af82-4bad-9130-b1925a2792e8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.387253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:47.388910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.389784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.390306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.390777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.391819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:47.392330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.394368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.395854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:47.413065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 299/611] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 09 04:44:47.415738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 313/612] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:47.425032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.436519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5203e56-fb6f-4c14-a000-6cd08f210ba8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.441584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.442467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.442949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.443419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.444491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=b400457cc4a343f6a25e43f6d24edc42) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:47.445020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.447592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.454131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 300/613] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/role_assignments?user.id=b400457cc4a343f6a25e43f6d24edc42&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:47.458793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.472799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f677ad-29e3-4fca-898a-921f29b76bbd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.481364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.482513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.482999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.483474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.484393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.486194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.503873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 09 04:44:47.505791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 314/614] 10.222.0.41 () {56 vars in 1150 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:47.512766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.527666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a075d-5d9b-42c8-8318-fecfc7582773 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.532935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.533863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.534385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.534861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.535825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:47.536418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.538198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49cdb62-9cf3-428f-a3b8-622c106b7518 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.543457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 301/615] 10.222.0.41 () {56 vars in 1145 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:47.553071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:47.569018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8693cca-e526-45a1-87c4-4063d4f274a0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:47.576171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:47.576871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:47.577208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:47.577489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:47.578252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:47.578618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:47.580410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009c47-1fbf-449a-bc9f-5b100957f6ca admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:47.592434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 315/616] 10.222.0.41 () {56 vars in 1145 bytes} [Tue Nov 9 04:44:47 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:48.669157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae2db-a80c-4f99-9dcd-a350c3c8eb95 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.670406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae2db-a80c-4f99-9dcd-a350c3c8eb95 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.670893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dae2db-a80c-4f99-9dcd-a350c3c8eb95 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.672920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 302/617] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:48.679187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.680170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.680713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.707562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:48.709220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:48.718344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 316/618] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:48.755423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae2db-a80c-4f99-9dcd-a350c3c8eb95 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:48.770523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dae2db-a80c-4f99-9dcd-a350c3c8eb95 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:48.776198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb5ebd-231e-40ab-b213-c60788e90fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:48.777229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5ebd-231e-40ab-b213-c60788e90fae admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.777710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5ebd-231e-40ab-b213-c60788e90fae admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.778182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb5ebd-231e-40ab-b213-c60788e90fae admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.794152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb5ebd-231e-40ab-b213-c60788e90fae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:48.801583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-8cbb5ebd-231e-40ab-b213-c60788e90fae admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:48.802967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 303/619] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:48.809565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:48.818913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e644791-b2ab-481c-91e8-1914fc14944d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:48.827822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:48.828768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.829264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.829740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.830743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:48.831293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:48.833181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:48.839326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e471-c2eb-4e86-a301-5a322c30b211 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.839862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e471-c2eb-4e86-a301-5a322c30b211 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.840147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31e471-c2eb-4e86-a301-5a322c30b211 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.842057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 304/620] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:48.845513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 317/621] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:48.851415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.851541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:48.851751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.852011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.865085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039b910-9c95-4954-a614-7c21afc8a9f8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:48.878416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:48.879562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.880146 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.880664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.888022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:48.893293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:48.899055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:48.902180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:48.909919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 305/622] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 09 04:44:48.925043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:48.926836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 318/623] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:48.933174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:48.942965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1bfff-f8d0-4b53-8926-542487df936d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:48.948384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:48.949341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.949826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.950301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.952139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:48.957695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:48.959303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:48.964735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:48.966839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b0ae8-9fa6-4ec6-9767-147f34dc9931 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:48.976990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:48.978242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:48.978729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:48.980020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:48.988672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 306/624] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:48.995398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.006774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:49.008745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d62c67-b19d-458e-81a5-be60b01d0de0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.015155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:49.017011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 319/625] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:49.021312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.022878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.025519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.026016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.027952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.041703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69aaa-7d37-4e4e-bdae-64a173202000 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.044624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.047774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.054533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.055605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.057142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.057655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.062819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.063517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.066639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.083419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:44:49.085321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 307/626] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:44:48 2021] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:49.090230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 320/627] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:49.092457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.096558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.105766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22645b68-1408-4a74-b44d-1c885fed0c4f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.110037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce550-f7d7-485e-904e-38ecc3ec72e1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.116032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.117517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.117805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.118083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.120473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.121311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.121647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.121975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.122662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.122976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.125695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.142263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.144382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.162196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 308/628] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:49.168538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.180030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:49.183194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 321/629] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:49.185036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c6d7c-1463-42c9-9f47-da4f08a27b06 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.189025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.192721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.194749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.195036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.195316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.208258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae788d-5a6d-44ef-916c-d5dc0c0d4fe2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.215677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.216600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.217263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.219104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.219393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.220369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.220823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.221141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.222977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.250387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 322/630] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:49.251813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:49.253365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 309/631] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:49.256358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.260554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.266846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5a7d2-16db-4346-a3ef-6d9256e18dda admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.271477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.272371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.272659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.272828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e64cb-6d67-42ff-9b2c-887f38fea920 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.272981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.281036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.283184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.286618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.287285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.287561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.287856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.288599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.288900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.290515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.299763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 09 04:44:49.301307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 323/632] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:49.307849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.315725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 310/633] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:49.320572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c75ecb-35a5-4224-b887-ed25ac7ef686 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.322724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.333974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.334828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.335116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.335391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.338438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.338754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.338924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da4238-4df8-4cf6-b19d-ed99758d33a6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.343744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.347016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.349229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.349568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.349902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.361872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.363882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.375090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 324/634] 10.222.0.41 () {56 vars in 1170 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:49.379366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:49.380945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 311/635] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:49.381263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.388949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.400066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a5f99-dac1-4b41-814a-d2c8480e89dd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.411604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55581b04-4cd1-42b5-a955-055655bfd58f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.413100 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.414046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.414539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.415937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.429046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.430127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.430624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.431684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.432828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.433387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.435543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.438768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.440925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.458175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 312/636] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:49.463732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 325/637] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 09 04:44:49.464860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.464990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.475083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc196c-e4d2-4ebf-bbcf-3c10dffa2e57 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.481358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.482473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.482984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.483466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.486173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a7f2-75e7-48dc-80f9-b9dc01212433 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.496393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.497643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.498533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.498826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.499106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/c16b11a1bbac45c0b869734149bd3416/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.499702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.505005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=c16b11a1bbac45c0b869734149bd3416, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.507652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.518393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:49.520345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 313/638] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:49.527760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.537573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 326/639] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:49 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/c16b11a1bbac45c0b869734149bd3416/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:49.558815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21973a8b-94bc-43ae-91e7-c7d881535e43 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.638983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.639706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.640052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.640336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.641097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.641408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.643082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024296b-1667-423a-aea8-6e330dd4e1e5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.659153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 314/640] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:49.669022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.678928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9962-0f37-4270-a5f0-9ede976902e4 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.679393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9962-0f37-4270-a5f0-9ede976902e4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.679488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c9962-0f37-4270-a5f0-9ede976902e4 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.684957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 315/641] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:49.686217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f374c16-cf94-4388-913e-f563cd9c54e8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.692161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.692773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.693318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.695666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.697131 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.697416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.697692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.713749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.718289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.731749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:49.734268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:49.751269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:49.753540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 316/642] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 09 04:44:49.755444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 327/643] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:49.762226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.777732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4d9fd-cf09-4892-987c-2a6b427fc3a9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.783810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.784680 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.785145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.785628 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.786626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.787117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.789175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.795072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.806629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 317/644] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:49.808809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dacba-fe6c-4f68-96e0-91582935c95a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.813047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:49.819379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.819379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.819379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.819379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.819780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.819780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:49.819780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:49.819780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:49.819780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2475c-3790-4a97-b53f-20b67becdf91 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.825686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7129e893-019c-4bb3-804f-99827034f0b1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:49.832173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:49.833030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:49.833485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:49.833943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:49.834854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=65bdf4f5171f4c4e8a4eca9592fc880e) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:49.835258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:49.840971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e6f4f-6041-450b-b761-60e0920bce05 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:49.846809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 328/645] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:44:49 2021] POST /identity/v3/services => generated 240 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:49.854442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 318/646] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:49 2021] GET /identity/v3/role_assignments?user.id=65bdf4f5171f4c4e8a4eca9592fc880e&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:50.501061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25478ac-93a4-4666-91c6-926c0562822e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.501433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25478ac-93a4-4666-91c6-926c0562822e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.501685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25478ac-93a4-4666-91c6-926c0562822e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.504457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 329/647] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:50.510771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da8ec-ac69-4c5c-901c-1c20fb38ef90 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.511207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da8ec-ac69-4c5c-901c-1c20fb38ef90 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.511516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4da8ec-ac69-4c5c-901c-1c20fb38ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.536650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3e4da8ec-ac69-4c5c-901c-1c20fb38ef90 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:50.537859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3e4da8ec-ac69-4c5c-901c-1c20fb38ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:50.561186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 319/648] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:50 2021] POST /identity/v3/auth/tokens => generated 1013 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:50.590217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc4fab-4de8-4958-92cf-cea419cfb357 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.590508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc4fab-4de8-4958-92cf-cea419cfb357 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.590790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc4fab-4de8-4958-92cf-cea419cfb357 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.592913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 330/649] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:50.598742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372671f-8007-4de3-8932-eda455652122 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.599036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372671f-8007-4de3-8932-eda455652122 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.599317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372671f-8007-4de3-8932-eda455652122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.602393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc4fab-4de8-4958-92cf-cea419cfb357 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:50.620549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b372671f-8007-4de3-8932-eda455652122 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:50.621726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b372671f-8007-4de3-8932-eda455652122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:50.630185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc4fab-4de8-4958-92cf-cea419cfb357 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:50.637236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:50.637898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.638184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.638466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.639208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:50.640814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:50.645336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 320/650] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:50 2021] POST /identity/v3/auth/tokens => generated 1013 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:50.672999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372671f-8007-4de3-8932-eda455652122 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:50.673554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 331/651] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:44:50 2021] POST /identity/v3/services => generated 251 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:50.693697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372671f-8007-4de3-8932-eda455652122 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:50.719737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:50.720541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.720817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.721140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.740980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:50.748057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:50.755376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 321/652] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:50.756806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:50.776634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f13ae-ce9f-4d00-bd32-f258d8ec063b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:50.787176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:50.787948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.788232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.788559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.789352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:50.789660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:50.791973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:50.811737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 332/653] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:50.817843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:50.834293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf981-dd40-4a92-a14e-6ddc18fd3bf5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:50.843941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:50.844752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.845032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.845359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.864692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:50.866550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:50.890746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:50.898300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 322/654] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:50.900264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:50.913170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a211779a-3d42-4625-b6af-b36defbd1706 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:50.921230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:50.921897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.922231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.922514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.923272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:50.923574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:50.925303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:50.937977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 333/655] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:50.943891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:50.957176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d2f37-b0b4-4ff2-915d-c249ca18babf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:50.964884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:50.965673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:50.965948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:50.966220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:50.978669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:50.980722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:50.999646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 09 04:44:51.006199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 323/656] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:51.007548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.018374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c3f3a-3b63-47dd-8d85-903b8c9ced29 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.028568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.029255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.029534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.029816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.030677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:51.030987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.032849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.055730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 334/657] 10.222.0.41 () {56 vars in 1156 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:51.057770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.072836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e4e6c-251d-400b-b1e1-8c578cb88473 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.085373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.086026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.086363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.086641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.099940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.102001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.115331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 324/658] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:44:51.121942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.131938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228421-608e-4135-9623-094f89d5e541 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.137198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.138053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.138337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.138617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.150591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.152447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.170199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:51.175754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 335/659] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:51.178076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.188610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1e765-0f58-47a3-86d1-8f675cc99d58 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.200318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.201282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.201568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.201841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.202586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:51.202875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.204513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.217557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 325/660] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:51.223946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.233780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a76f4-80c6-42a0-bd77-92321dfbf1ea admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.243808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.244598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.244879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.245152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.257019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.259452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.272416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:51.279724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 336/661] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:51.281852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.292625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1f725-82ce-4036-9511-b14cbb58554e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.297701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.298378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.298660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.298932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.299787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:51.300100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.302267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366bc9c-aeff-42a9-80b7-b65916a0278e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.319732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 326/662] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:51.323651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:51.333996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adb1eb-d6c9-489c-a51f-7ac2eedf59f8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:51.339233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:51.339897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:51.340181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:51.340462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:51.341308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=b400457cc4a343f6a25e43f6d24edc42) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:51.341619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:51.343436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9e5b6-a1f3-4b0c-afb3-02e2ac311eb8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:51.349412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 337/663] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:51 2021] GET /identity/v3/role_assignments?user.id=b400457cc4a343f6a25e43f6d24edc42&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:52.369697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5b00-c88e-49a6-a002-e6a155652b16 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.370399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5b00-c88e-49a6-a002-e6a155652b16 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.370399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c5b00-c88e-49a6-a002-e6a155652b16 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.372364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 327/664] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:52.378233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.378735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.379013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.400896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:52.402070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:52.414459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 338/665] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:52 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:52.438928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c5b00-c88e-49a6-a002-e6a155652b16 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.453473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c5b00-c88e-49a6-a002-e6a155652b16 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.457896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.458680 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.459094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.459368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.473950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:52.481262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:52.482803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 328/666] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:52.488754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.498396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d272b-2715-4667-8208-29b9f4285158 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.507723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.508395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.508718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.509016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.509787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:52.510093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.511726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.527054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 339/667] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:52.533252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.548823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f55c3-f094-4194-954e-106c7f72f7e1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.561787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.562594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.562872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.563141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.580744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.582664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.608143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:52.609787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 329/668] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:52.615888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.626849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18bd59-f732-4cbe-913c-87e2efb88f26 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.636076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.636808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.637094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.637370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.638180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:52.638538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.640269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.657041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 340/669] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:52.662869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.675317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2de91-057c-4e46-bb0a-2393a8c8c3d1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.682415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.683191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.683522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.683819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.696972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.701863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.720556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-065a4155-e6b9-42db-87c2-472acdcb9684 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:44:52.721902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 330/670] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:52.728448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.738305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b18925-a69c-4366-8a6e-cc25504b555b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.748060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.748787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.749071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.749347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.750606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:52.750919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.753031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01921214-e6ea-443b-9900-87fdf00dcf41 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.753306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01921214-e6ea-443b-9900-87fdf00dcf41 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.753572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01921214-e6ea-443b-9900-87fdf00dcf41 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.755664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 331/671] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:52.757312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.761066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.761347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.761621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.793482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 341/672] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:52.793843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:52.795326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:52.799337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.809734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe480f-acb9-4b19-b6b1-7503d4a44f5f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.814351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.814984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.815316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.815596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.820181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 332/673] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:52 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Nov 09 04:44:52.826354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.828188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.838220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 342/674] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:44:52.848373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.854598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.863103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8859709-be98-4ee5-bbff-b97d232032af None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.869501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.869935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762babd8-4717-42a1-b7af-4c70b0d18c60 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.870346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.870627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.870933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.874683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.875469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.875800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.876080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.888297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:52.888449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.890283 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.895964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:52.897613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 343/675] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:52.904682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.914406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295dee54-cd33-4474-92a5-613aa7601d29 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.918976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.919651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.920216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.920500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.921274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:52.921587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.921798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:52.923193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.924293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 333/676] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:52.929852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.936929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 344/677] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:52.942976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:52.950432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a3ab3-5dbd-46a1-b460-d388e789bc29 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.960539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab432e07-ba47-49b1-a170-a1f773c0d719 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:52.964402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.965095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.965581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.965866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.967204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:52.967523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.971836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:52.972701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:52.972990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:52.973270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:52.973616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:52.996282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:52.999360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 334/678] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.000451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.012737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.021393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:53.023140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 345/679] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:53.028792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.035666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e08d-2156-4c6b-8e2e-7420ce7bcfd9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.044734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.046001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.046503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.046916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.051590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10179a01-3c7a-4104-ac49-44d01cb3a938 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.062393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.062393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.071934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.072629 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.072918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.073198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.073958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.074271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.075936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.085024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:53.086248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 335/680] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:53.096613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.106139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 346/681] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.106572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7590f2b-5094-4080-8b36-e8f74af4e1ab admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.111841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.122813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4073f4-5e9e-46d4-a58b-aefe2a9abc01 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.123896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.124682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.124969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.125252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.126158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.126596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.127508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.128458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.128561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8c744c-3dfa-4bee-95c0-92f7f59e7502 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.128753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.129039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.140644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.141643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 336/682] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.142613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.143045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1928-8959-4ce8-b1e9-ef4b9182b68f None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.143340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1928-8959-4ce8-b1e9-ef4b9182b68f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.143645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a1928-8959-4ce8-b1e9-ef4b9182b68f None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.145503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 337/683] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:53.150925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a1928-8959-4ce8-b1e9-ef4b9182b68f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.157846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b8e0b32a-4aa4-4ad6-9b16-b268dfd92a06 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 09 04:44:53.159894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 347/684] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:53.164383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.164671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.164988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.171218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a1928-8959-4ce8-b1e9-ef4b9182b68f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.176832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.177545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.177885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.178167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.179076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=c16b11a1bbac45c0b869734149bd3416) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.179397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.181853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.186913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:53.188407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:53.188906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 338/685] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/role_assignments?user.id=c16b11a1bbac45c0b869734149bd3416&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.189750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.198897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 348/686] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:53 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:53.200772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7bb8c-6ac6-495e-8c52-8523a8de23bf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.208075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.208896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.209247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.209643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.210671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.211052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.213159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.226074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.234706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 339/687] 10.222.0.41 () {56 vars in 1170 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.237323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a236e03-8aec-471e-ac59-6096226c552f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.240713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.244154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.245028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.245313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.245597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.246333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.248091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.251612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b048e-ee00-42cc-ade7-9421d09030b3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.256447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.257255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.257543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.257818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.261084 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 09 04:44:53.262584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 349/688] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:53.272218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.275031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.277056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.289341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6ec9f-6985-4cbb-82f6-df0ef6986919 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.295697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:53.297191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 340/689] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:53.305121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.313546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.314284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.314572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.314855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.315671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.315988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.319333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.323568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cbb63-6145-4970-9207-345d5d1fbe63 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.331738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 350/690] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services?name=network => generated 124 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.333002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.333658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.333940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.334216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.334977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.335284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.341928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.348230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.361020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950502-4af0-47a3-99ed-57f24e7fb64c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.371280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 341/691] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.372012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.372758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.373051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.373332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.374085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.374396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.376103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.377681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.390081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 351/692] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services?type=network => generated 350 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:53.396613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874aa89-d0d6-4d47-99c0-ca5f08149bad admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.402482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.410140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.410966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.411248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.411522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.417934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f699107-5fd7-4b5a-ba00-22a8596d85f6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.425796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.431652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.431933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.431933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.431933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.431933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.432548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] RBAC: Adding query filter params (interface=public, service_id=c4382251bf5a482cb406ba99bd4cf3c1, region_id=RegionOne) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.432548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.433577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:53.433577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:44:53.433577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:44:53.434782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.447673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:53.447673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 342/693] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:53.454698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.465023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 352/694] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/endpoints?service_id=c4382251bf5a482cb406ba99bd4cf3c1&interface=public®ion_id=RegionOne => generated 194 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:53.470292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a245033-188b-48a3-8f21-5759512cc876 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.472620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.475014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.475719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.476084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.476337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.477206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.478074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.480184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.495421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee311b4-e39b-4fc2-9bec-b767747d2908 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.497230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 343/695] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.502592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fc1ea-8777-4f8d-af7b-7709927216c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.503282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc1ea-8777-4f8d-af7b-7709927216c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.503573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc1ea-8777-4f8d-af7b-7709927216c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.503899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fc1ea-8777-4f8d-af7b-7709927216c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.504191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.504614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fc1ea-8777-4f8d-af7b-7709927216c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.506329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fc1ea-8777-4f8d-af7b-7709927216c5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.512732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 353/696] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services => generated 772 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.517509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c190240-04d9-4eb5-9b1e-4baeadd29e85 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.524091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a64a8-1f62-40e4-9e8d-780817227781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.525823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a64a8-1f62-40e4-9e8d-780817227781 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.526320 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a64a8-1f62-40e4-9e8d-780817227781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.526791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a64a8-1f62-40e4-9e8d-780817227781 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/65bdf4f5171f4c4e8a4eca9592fc880e/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.546788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a64a8-1f62-40e4-9e8d-780817227781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=65bdf4f5171f4c4e8a4eca9592fc880e, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.550018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a64a8-1f62-40e4-9e8d-780817227781 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.570806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 344/697] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:53 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/65bdf4f5171f4c4e8a4eca9592fc880e/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:53.600435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513bb4-6366-49da-936e-e548dea252b4 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.600779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513bb4-6366-49da-936e-e548dea252b4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.601004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513bb4-6366-49da-936e-e548dea252b4 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.603731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 354/698] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:53.610516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.610810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.611089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.632027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:53.633293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:53.702543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 345/699] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:53 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:53.728472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e513bb4-6366-49da-936e-e548dea252b4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.741639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e513bb4-6366-49da-936e-e548dea252b4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.746405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.747342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.747650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.747942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.748693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.750406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.763317 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 09 04:44:53.764951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 355/700] 10.222.0.41 () {56 vars in 1150 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:53.772206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.786913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e85d85-8d65-4fdc-9b4e-a6c8d771d2f9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.792520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.793253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.793535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.793809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.794626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.795202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.796929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.804915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 346/701] 10.222.0.41 () {56 vars in 1145 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.813452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.823851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c448371-f5d1-415f-bb6d-b90b1bb51849 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.828703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.829392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.829735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.830026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.830820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.831137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.832859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.839560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 356/702] 10.222.0.41 () {56 vars in 1145 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.846002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.857266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf235fa2-7472-441a-8230-250c7113d351 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.863811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.864478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.864760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.865089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.865908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] RBAC: Adding query filter params (interface=public, service_id=e01689430a4c4dc99566b6b05749ca6e, region_id=RegionOne) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:53.866314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.867473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:53.867473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:53.867473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:53.868527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d710c59e-47e3-48a5-9f9a-422472f67e33 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.877116 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 347/703] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/endpoints?service_id=e01689430a4c4dc99566b6b05749ca6e&interface=public®ion_id=RegionOne => generated 194 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:53.882854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:53.896352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf838a4-3d66-4cfa-8dc0-dd559aafc4d8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:53.902513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ce86b-ed4d-428f-99de-327321e86158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:53.903188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce86b-ed4d-428f-99de-327321e86158 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:53.903644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce86b-ed4d-428f-99de-327321e86158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:53.903933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ce86b-ed4d-428f-99de-327321e86158 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:53.904640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ce86b-ed4d-428f-99de-327321e86158 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:53.906235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ce86b-ed4d-428f-99de-327321e86158 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:53.912810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 357/704] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:44:53 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:54.271155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3ce8-f1da-4226-b23d-e9496f089a71 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.271734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3ce8-f1da-4226-b23d-e9496f089a71 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.271734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb3ce8-f1da-4226-b23d-e9496f089a71 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.273736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 348/705] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:54.279877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.280171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.280453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.302628 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:54.303839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:54.318320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 358/706] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:54 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:44:54.342415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3ce8-f1da-4226-b23d-e9496f089a71 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.355206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb3ce8-f1da-4226-b23d-e9496f089a71 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.359737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.360569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.360853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.361187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.372278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:54.379189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:54.387514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 349/707] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:54.388508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.401099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8c62-c0fc-4731-9b65-78d370e314a0 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.407789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.408455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.408739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.409015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.409784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:54.410088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.411689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.423229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 359/708] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:54.429713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.443015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb09e-a4a3-4ad0-ac15-4df9b4c7b85f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.449468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.450556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.451038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.451525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.468328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.470504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.492286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:54.493836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 350/709] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:54.500211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.517810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d6c53-f72c-4fe9-8be4-80b6069c3384 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.522299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.522903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.523188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.523465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.524745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:54.525104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.526717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.540680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 360/710] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:54.546804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.560776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52c046-558a-46a2-858b-5dd81bead248 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.572326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.573141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.573427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.573708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.584773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.587375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.611163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 09 04:44:54.612383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 351/711] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:54.618879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.631808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6ab2-fbe4-4b6c-b445-63c500975da1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.641556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.642284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.642567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.642842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.643836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:54.644149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.646024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.664797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 361/712] 10.222.0.41 () {56 vars in 1156 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:54.672368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.684540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb476ecf-fdad-424a-acc8-407e7308c309 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.691783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.692580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.692862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.693135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.715805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.717639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.739402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:54.740607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 352/713] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:54.747099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.761008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ddc04-6707-41a3-a228-47c8e4601332 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.768176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.768930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.769213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.769491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.770332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:54.770693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.772494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.786560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 362/714] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:54.793138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.808846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb46752-3561-46cd-b682-931851c3e47c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.817141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.817930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.818207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.818480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.828746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.830702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.847046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:54.848258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 353/715] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:54.854873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.868931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083aa6a-017d-437d-b86e-1dc892df5bc0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.873629 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.874288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.874577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.874858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.875701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:54.876020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.877867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379adde7-77e2-4485-97a8-68cc9f752a0f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.895124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 363/716] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:54.902364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:54.917065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb15ef-fd9f-478c-9157-02b7e6899fad admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:54.925163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf61df-4671-4e81-acd2-62177ee4d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:54.926050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf61df-4671-4e81-acd2-62177ee4d332 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:54.926327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf61df-4671-4e81-acd2-62177ee4d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:54.926601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf61df-4671-4e81-acd2-62177ee4d332 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/b400457cc4a343f6a25e43f6d24edc42/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:54.928625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf61df-4671-4e81-acd2-62177ee4d332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=b400457cc4a343f6a25e43f6d24edc42, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:54.931302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf61df-4671-4e81-acd2-62177ee4d332 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:54.953935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 354/717] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:44:54 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/b400457cc4a343f6a25e43f6d24edc42/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:44:56.010820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb958e-1153-4270-8fc5-87e37dea0062 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.011538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb958e-1153-4270-8fc5-87e37dea0062 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.011538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb958e-1153-4270-8fc5-87e37dea0062 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.013469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 364/718] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:56.019240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.019764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.019918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.037792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:56.038963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:56.131410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 355/719] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:56 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:56.168561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb958e-1153-4270-8fc5-87e37dea0062 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.189586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb958e-1153-4270-8fc5-87e37dea0062 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.200165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.201209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.201704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.202214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.203080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.204905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.223701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 09 04:44:56.225448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 365/720] 10.222.0.41 () {56 vars in 1153 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:56.231747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.244597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f5e9c0-71b1-42cf-98ca-3a1273f44349 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.253841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.254510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.254801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.255082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.255850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.256156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.257771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9a8db-bcf2-4058-81f9-cb85f1865954 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.267978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 356/721] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.273772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.275712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe1fbf-1b98-450d-a629-d3b04c85a0d3 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.276006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe1fbf-1b98-450d-a629-d3b04c85a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.276284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe1fbf-1b98-450d-a629-d3b04c85a0d3 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.278238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 357/722] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:56.283701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.283995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.284275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.289997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e36bf-b813-4b1c-87c7-ff5de14b71db admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.301557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.302225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.302515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.302797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.303528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.303862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.305607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.311438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:56.312663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:56.314431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 366/723] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.332325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 358/724] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:56 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:44:56.356659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.366558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3e98-5080-46c2-8b1f-9f69a374f3ab admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.371264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.372117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.372406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.372687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.373366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.374983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.387643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 09 04:44:56.389361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 367/725] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:56.396454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.411822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34afb47-1359-45e5-974f-e085b4fc7a6b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.416867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.417613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.417908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.418186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.418937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] RBAC: Adding query filter params (name=network) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.419247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.421272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.426835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 359/726] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.433541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.444166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bd20f-9c03-41fd-89b4-46dbb0c6791a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.449685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.450382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.450714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.450995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.451823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.452137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.453835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a7efa-c4d0-440e-9499-2322a2fa5bf0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.460567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 368/727] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/services?type=network => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.467473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.477630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca80ae-b6b7-449b-8905-11076b872b6a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.482306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.483017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.483295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.483573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.484416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.485491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:56.485491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:56.485491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:56.486375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f22d43-b85f-4185-ad97-2bac69d768da admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.517007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 360/728] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:44:56 2021] POST /identity/v3/endpoints => generated 327 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:56.604582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1463-073d-4e9d-bcb9-e4c03fe68d47 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.604920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1463-073d-4e9d-bcb9-e4c03fe68d47 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.605154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1463-073d-4e9d-bcb9-e4c03fe68d47 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.607389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 369/729] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:56.614088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.614403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.614652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.636675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:56.637899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:56.664058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 361/730] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:56 2021] POST /identity/v3/auth/tokens => generated 1266 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:56.692785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1463-073d-4e9d-bcb9-e4c03fe68d47 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.709777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1463-073d-4e9d-bcb9-e4c03fe68d47 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.720059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.720871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.721152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.721428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.734761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:56.741979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:44:56.747772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 370/731] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:56.751097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.761147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d1947-2209-4e0b-9dc7-b6da9b800a0d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.765618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.766292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.766574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.766849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.767781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.768089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.769699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.785929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 362/732] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.787357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.797540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2205dc-ba27-4800-8c4d-87e3891b4a84 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.802249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.803089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.803371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.803700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.816882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.818905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.837452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:56.843825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 371/733] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:56.845673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.856167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764a62c-aefe-4bf0-be53-4e29913e71d7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.861019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.861684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.862018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.862293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.863107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.863416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.865144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.884242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 363/734] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.886355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.896706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea60956-ecae-47b0-91f3-d67d3c4ade04 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.901642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.902506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.902790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.903063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.914043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.916198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.931036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 09 04:44:56.936865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 372/735] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:56.939064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.949703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123e430-bff7-4c27-bb1c-c70669ef1417 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.954259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:56.954917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.955213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.955520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:56.956417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:56.956769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:56.958685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bdf1-68c6-4e48-a5f2-7df781f7bca8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:56.982989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 364/736] 10.222.0.41 () {56 vars in 1170 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:56.984442 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:56.996474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab9f32-9fb1-4c23-ba3b-209ceac21da1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:56.997989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a2273-cb28-4eab-9d81-84c0b9f4423e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:56.998284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a2273-cb28-4eab-9d81-84c0b9f4423e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:56.998567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a2273-cb28-4eab-9d81-84c0b9f4423e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.001050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.001746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.002029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.002401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.005621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 365/737] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:57.006907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.007196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.007751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.011607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.013675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.025088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 373/738] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:56 2021] GET /identity/v3/auth/tokens => generated 1266 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:44:57.029396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:57.030645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:57.031666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.039664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 366/739] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:57 2021] POST /identity/v3/auth/tokens => generated 1266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:44:57.042202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe9d03-f017-4c04-b7ba-84a62ffde58a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.047206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.048059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.048341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.048669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.061038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.062882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.067004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.078898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539a0ec-87a5-425e-b65c-946aca58f816 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.083888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:57.084357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.085111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 374/740] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:57.085222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.085438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.085714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.086459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.088127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:44:57.088127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:44:57.088127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:44:57.089016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.093224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.103884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 09 04:44:57.105350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 367/741] 10.222.0.41 () {56 vars in 1150 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:57.106598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103ba8-59e8-4c07-b8f6-5bb8bbf224fe admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.111473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.111723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.112289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.112572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.112849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.113746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:57.114054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.115784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.122740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19acc379-a23e-437b-8515-8399aed4ab5a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.128524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.129176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.129504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.129739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.130456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:57.130760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.132384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.134088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 375/742] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:57.138169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.138358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 368/743] 10.222.0.41 () {56 vars in 1145 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:57.144925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.148023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4405a92-2c4d-4861-a097-c341f1f6f181 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.153830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.154607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.154888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.155162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.155332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8ead-cf32-4b67-853c-4f0cc4ad7b8e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.161304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.162041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.162326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.162925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.163670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:57.164008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.164172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.165990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.166713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.174379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 369/744] 10.222.0.41 () {56 vars in 1145 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:57.180274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.180626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:57.187016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 376/745] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:57.189691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.192390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95054edd-68a8-45e8-8a02-b7565cc411b6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.197657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.198502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.198828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.199109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.200475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.202348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.203500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7126fd-4644-46f5-a4d7-4aad09e7c224 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.209024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.209926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.210213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.210987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.212805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:57.213194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.215246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583aa00d-e5dc-4b00-a87c-6de3ea8c9989 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.225431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 370/746] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:44:57 2021] POST /identity/v3/endpoints => generated 346 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:44:57.234102 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 377/747] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:57.238566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:57.261459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5843e-3682-4ba2-bf84-d1d302d23e26 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:57.266416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:57.267141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:57.267426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:57.267754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:57.268732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=65bdf4f5171f4c4e8a4eca9592fc880e) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:57.269090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:57.271209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf18ce7-a808-4db4-883e-8c3365b92bc0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:57.278617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 371/748] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:57 2021] GET /identity/v3/role_assignments?user.id=65bdf4f5171f4c4e8a4eca9592fc880e&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.046108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39d72-4cfb-4cdf-a4e8-4c5acaafef50 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.046625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39d72-4cfb-4cdf-a4e8-4c5acaafef50 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.046767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39d72-4cfb-4cdf-a4e8-4c5acaafef50 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.048865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 378/749] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:58.054950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.055332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.056074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.073700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:58.074966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:58.087738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 372/750] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:58 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:58.108105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39d72-4cfb-4cdf-a4e8-4c5acaafef50 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.121071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a39d72-4cfb-4cdf-a4e8-4c5acaafef50 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.125454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.126240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.126524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.126800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.137400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:58.144562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:44:58.151809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 379/751] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:58.153170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.162118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35616e4a-1cef-42f1-8c40-4eaa841736fd None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.167079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.167817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.168101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.168418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.169182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:58.169489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.171465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.183735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 373/752] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.186456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.197465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1610a7-ecc9-4e5d-825d-7ca0b00b19d5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.201869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.202643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.202924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.203195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.214026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.215898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.232447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:58.233981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 380/753] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:58.239935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.251497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525645f4-35df-4509-a80d-fec1f1e764d5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.256169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.256835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.257184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.257465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.258209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:58.258545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.260216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.273434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 374/754] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.279949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.289845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668c8ea-73e1-4166-903b-d9f33901fe16 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.295154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.296001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.296346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.296571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.304567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.306627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.320038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 09 04:44:58.321625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 381/755] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/users/swift => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:58.327856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.338213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbbfc7-49f5-432b-a688-970eeab74721 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.342819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.343549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.343875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.344155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.345110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:58.345424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.347261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.365906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 375/756] 10.222.0.41 () {56 vars in 1156 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.372318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.382182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6c44c-3e8f-4514-b721-9be0d90f9906 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.386862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.387561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.387890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.388173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.396370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.398143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.411656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 382/757] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:44:58.418448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.428681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3a780-0555-4df1-9220-ab15975d2866 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.433474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.434364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.434649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.435076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.450147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.452115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.470235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:58.471763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 376/758] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:58.478081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.487144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d47b76-ac42-416c-85d7-9c800be7c970 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.491808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.492533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.492823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.493139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.493947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:58.494261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.495880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.509558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 383/759] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.516097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.527217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b003b-e047-43f4-8c75-0d10e4826b6d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.532113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.532919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.533255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.533536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.541226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.543246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.563216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:44:58.564367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 377/760] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:58.577723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.588962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda02be6-01fe-447c-9a06-adff3a4ff200 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.593974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.594846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.595334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.595793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.596747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:58.597226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.599262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac041c-e094-4afb-8341-e43a2192b38a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.612233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 384/761] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.619202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.631045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc73b8-5cae-4605-8b91-6a1868cc05e1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.636756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.637604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.638053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.638498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.639553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=b400457cc4a343f6a25e43f6d24edc42) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:58.640059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.642207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8e19-2a03-4a68-b2a2-d213320c6f36 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.649834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 378/762] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:44:58 2021] GET /identity/v3/role_assignments?user.id=b400457cc4a343f6a25e43f6d24edc42&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:58.891664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4d42-3d6a-414d-8e1f-f428a9f98075 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.891986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4d42-3d6a-414d-8e1f-f428a9f98075 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.892246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c4d42-3d6a-414d-8e1f-f428a9f98075 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.894281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 385/763] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:58.902645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74797b47-72c5-441d-bc69-2f5c86345a2b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.902935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74797b47-72c5-441d-bc69-2f5c86345a2b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.903213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74797b47-72c5-441d-bc69-2f5c86345a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.922020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-74797b47-72c5-441d-bc69-2f5c86345a2b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:58.923219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-74797b47-72c5-441d-bc69-2f5c86345a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:58.931248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 379/764] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:58 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:58.954873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4d42-3d6a-414d-8e1f-f428a9f98075 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:58.967919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c4d42-3d6a-414d-8e1f-f428a9f98075 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:58.972522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753a43f-4e04-4f3d-9cb7-d06e1a5e87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:58.973178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a43f-4e04-4f3d-9cb7-d06e1a5e87fd admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:58.973464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a43f-4e04-4f3d-9cb7-d06e1a5e87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:58.973745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753a43f-4e04-4f3d-9cb7-d06e1a5e87fd admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:58.974506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a43f-4e04-4f3d-9cb7-d06e1a5e87fd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:58.976135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753a43f-4e04-4f3d-9cb7-d06e1a5e87fd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:58.991774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 386/765] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:44:58 2021] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:44:59.611496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc4a76-7c2d-4b3d-aaa5-810b55b4d4d9 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.612032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc4a76-7c2d-4b3d-aaa5-810b55b4d4d9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.612208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc4a76-7c2d-4b3d-aaa5-810b55b4d4d9 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.614074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 380/766] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:44:59.620794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632a8d5-446a-4b92-a4cf-9c1961a8faca None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.621214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632a8d5-446a-4b92-a4cf-9c1961a8faca None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.621381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632a8d5-446a-4b92-a4cf-9c1961a8faca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.639643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6632a8d5-446a-4b92-a4cf-9c1961a8faca None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:59.640841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6632a8d5-446a-4b92-a4cf-9c1961a8faca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:59.665101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 387/767] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:59 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:59.689227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc4a76-7c2d-4b3d-aaa5-810b55b4d4d9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.702289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc4a76-7c2d-4b3d-aaa5-810b55b4d4d9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.706713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.707508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.707862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.708185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.708859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.710494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:59.720023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fc0c-47eb-4b92-8120-eb7047516fee None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.720309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fc0c-47eb-4b92-8120-eb7047516fee None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.720589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237fc0c-47eb-4b92-8120-eb7047516fee None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.722234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 09 04:44:59.722626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 388/768] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:44:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:44:59.723704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 381/769] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:59.729393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.729686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.729965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.730059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.740066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa5ba3-cbdc-4660-be75-d061d1d70019 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.745281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.745934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.746216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.746490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.747208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:59.747513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.749123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:59.749619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:44:59.751081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:44:59.753990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 382/770] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:44:59.760704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.763763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 389/771] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:44:59 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:44:59.776993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee16742-aad5-48d6-8ea4-1db11f4be2af admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.781682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.782333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.782675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.782953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.783808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:59.784829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.788029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.789697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:59.793858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f7772-d24f-4e2b-8d43-3a6f03481008 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.795094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 383/772] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:59.802599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.803450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.803774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.804053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.816803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:44:59.825224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 09 04:44:59.831800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 390/773] 10.222.0.41 () {56 vars in 1141 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:44:59.833636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.844026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48f9d7-1572-40d4-a22e-09e5caca0801 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.848903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.849705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.849989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.850266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.851117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:59.851428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.853344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:59.867786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 384/774] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:59.871033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.881439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d8ff9-0499-46d9-896a-170c279add74 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.886737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.887552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.887870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.888254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.900681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.902599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:59.920446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:44:59.927176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 391/775] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:44:59.928717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.939599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef35b5-db39-4560-b17e-af644916d22f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.944460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.945202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.945546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.945828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.947278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:44:59.947663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.949449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:44:59.967800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 385/776] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:44:59.970176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:44:59.981040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b859-c83b-4f25-987e-fc7667c26c56 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:44:59.985836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:44:59.986708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:44:59.986987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:44:59.987260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:44:59.997297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:44:59.999419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.014596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 09 04:45:00.019708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 392/777] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:44:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:00.022449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.032966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed68a1-2711-4584-911b-9c49165d3679 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.037877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.038549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.038833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.039111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.040571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:00.040923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.042792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.062884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 386/778] 10.222.0.41 () {56 vars in 1170 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:00.068904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.078726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fed948-e0aa-4ce0-bcd2-0b5ffcc595c1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.083049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.083730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.084017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.084293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.092371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.094113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.107495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 393/779] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:00.110222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.120822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4e8c-a9bd-4475-bad6-93871c0a5d2c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.125491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.126331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.126683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.126963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.137814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.139748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.157391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:00.163738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 387/780] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:00.166967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.176197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc26084-e10e-48eb-beb8-e41456bdf50e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.181174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.181815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.182149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.182431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.183166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:00.183469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.185089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.203127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 394/781] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:00.204538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.214512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a0c3a-1203-4f5d-8d78-49c8702c9fb3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.219031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.219891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.220173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.220447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.228123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.230128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.244053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:00.250959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 388/782] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:00.252440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.262348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16195e5-0b9e-45e6-a6da-e15d87f6da15 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.266866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.267568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.267873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.268151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.268991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:00.269296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.271284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7921d-d3b8-45c0-a06a-51cf58e71008 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.287742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 395/783] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:00.290272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:00.301252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4efe5b-2b12-473f-9caa-4569139a598f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:00.306425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:00.307141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:00.307470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:00.307773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:00.308652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] RBAC: Adding query filter params (role.id=16e746b24ea443cbb528d90400710aef, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=65bdf4f5171f4c4e8a4eca9592fc880e) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:00.308966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:00.310938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f600056-fe4b-47a9-959d-f0f909f18143 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:00.319709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 389/784] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:00 2021] GET /identity/v3/role_assignments?user.id=65bdf4f5171f4c4e8a4eca9592fc880e&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=16e746b24ea443cbb528d90400710aef => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:01.102252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913ca6-8617-4d7e-b3a7-a47f1e51f4bc None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.102252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913ca6-8617-4d7e-b3a7-a47f1e51f4bc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.102252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913ca6-8617-4d7e-b3a7-a47f1e51f4bc None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.102252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 396/785] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:01.111988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.111988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.111988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.129528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:01.131131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:01.139390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 390/786] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:01 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:01.163245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913ca6-8617-4d7e-b3a7-a47f1e51f4bc None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.176767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913ca6-8617-4d7e-b3a7-a47f1e51f4bc None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.181470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.182561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.183075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.183562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.184517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.187393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.199237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 09 04:45:01.200860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 397/787] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:01.207859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.218010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad90e84-7851-4c61-8e88-53369e981cbe None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.222716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.223395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.223710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.224000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.224741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:01.225053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.226670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66e9b5-a62c-48c4-a8e6-c70f7d0a1bb4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.232826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 391/788] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:01.239061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.248815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce90b29-3f0a-4116-9477-724cb60c8d72 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.253311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.253966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.254257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.254541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.255276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:01.255655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.257254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405eb23-3dd2-457c-9515-b9bd233824e4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.262006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 398/789] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:01.341330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caac25-2134-418d-aefb-00f3535ee390 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.341653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caac25-2134-418d-aefb-00f3535ee390 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.341906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caac25-2134-418d-aefb-00f3535ee390 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.344086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 392/790] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:01.354963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.355321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.355780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.375066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:01.376327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:01.384649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 399/791] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:01 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:01.408576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caac25-2134-418d-aefb-00f3535ee390 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.422603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caac25-2134-418d-aefb-00f3535ee390 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.427584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.428501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.428787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.429125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.429865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.431567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.444448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 09 04:45:01.446603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 393/792] 10.222.0.41 () {56 vars in 1153 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:01.453396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.463592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc6995-dd06-43a8-980e-330f915c7240 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.468386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.469121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.469407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.469690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.470536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:01.470846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.472553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.478558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 400/793] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:01.484722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.494716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1400c6-a8fa-4b6c-81ce-73728beff6cb admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.499325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.500045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.500330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.500607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.501404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:01.501721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.503324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.509568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 394/794] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:01.516017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.529484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d2a40-4fb1-44a0-94ad-5c596f814ad9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.534292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.534976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.535266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.535553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.536421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] RBAC: Adding query filter params (interface=public, service_id=6f413c38da294aad976ba99814b1282a, region_id=RegionOne) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:01.536739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.538490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc993ddb-a213-4aee-a8e6-19c7dbb1eb77 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.545219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 401/795] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/endpoints?service_id=6f413c38da294aad976ba99814b1282a&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:01.556123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:01.572332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37984e01-7659-460e-991e-e993757c84b8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:01.577155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892786c0-5615-481f-aa22-08e141a000a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:01.578051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892786c0-5615-481f-aa22-08e141a000a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:01.578485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892786c0-5615-481f-aa22-08e141a000a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:01.578945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892786c0-5615-481f-aa22-08e141a000a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:01.579854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892786c0-5615-481f-aa22-08e141a000a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:01.581750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892786c0-5615-481f-aa22-08e141a000a5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:01.588619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 395/796] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:45:01 2021] GET /identity/v3/services => generated 1029 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:45:02.098892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad22373-83d0-4f09-a84c-a53e7a47e29c None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.099264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad22373-83d0-4f09-a84c-a53e7a47e29c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.099460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad22373-83d0-4f09-a84c-a53e7a47e29c None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.103652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 402/797] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:02.109814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937656fb-bdc6-45b0-9f21-53e7ea489ea9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.110106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937656fb-bdc6-45b0-9f21-53e7ea489ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.110389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937656fb-bdc6-45b0-9f21-53e7ea489ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.128470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-937656fb-bdc6-45b0-9f21-53e7ea489ea9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:02.129648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-937656fb-bdc6-45b0-9f21-53e7ea489ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:02.138155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 396/798] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:02 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:02.161765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad22373-83d0-4f09-a84c-a53e7a47e29c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.174378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad22373-83d0-4f09-a84c-a53e7a47e29c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.178732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23006982-d19c-4c33-97c2-1930d45bbb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.179382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006982-d19c-4c33-97c2-1930d45bbb2c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.179694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006982-d19c-4c33-97c2-1930d45bbb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.179980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23006982-d19c-4c33-97c2-1930d45bbb2c admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.181269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23006982-d19c-4c33-97c2-1930d45bbb2c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:02.182854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23006982-d19c-4c33-97c2-1930d45bbb2c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:02.200696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 403/799] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:02 2021] POST /identity/v3/services => generated 251 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:02.655488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87d4bd-746e-4794-88a4-4bd17eaea3c5 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.655977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87d4bd-746e-4794-88a4-4bd17eaea3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.656360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87d4bd-746e-4794-88a4-4bd17eaea3c5 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.658510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 397/800] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:02.664681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa479-c090-4890-8116-633f94a98041 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.665101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa479-c090-4890-8116-633f94a98041 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.665489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa479-c090-4890-8116-633f94a98041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.684116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-28daa479-c090-4890-8116-633f94a98041 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:02.685315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-28daa479-c090-4890-8116-633f94a98041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:02.703262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 404/801] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:02 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:02.726455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87d4bd-746e-4794-88a4-4bd17eaea3c5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.738818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87d4bd-746e-4794-88a4-4bd17eaea3c5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.743761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.744559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.744846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.745120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.755506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:02.763275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 09 04:45:02.764736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 398/802] 10.222.0.41 () {56 vars in 1141 bytes} [Tue Nov 9 04:45:02 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:02.771069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa479-c090-4890-8116-633f94a98041 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.780188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa479-c090-4890-8116-633f94a98041 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.784696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.785373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.785666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.785949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.786798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:02.787116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:02.788817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:02.798754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 405/803] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:45:02 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:02.805137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.815532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fb308-c40c-40ba-aec6-29b0440e904d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.820074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.820802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.821648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.821927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.832759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:02.834606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:02.851027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:02.852526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 399/804] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:02.858642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.868850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee4c05-2af8-40ae-91d3-f7a23bbc5df5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.873385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.874051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.874344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.874627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.875383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:02.875736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:02.877338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:02.891204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 406/805] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:02.897421 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.911093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e248213-8e7b-4da1-9d8b-6ddb6a0e5c61 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.916741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.917547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.917893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.918175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.928105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:02.930195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:02.945239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 09 04:45:02.947360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 400/806] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:45:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:02.953672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:02.963730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048b9e-71a6-41c4-9aa9-56ba7b2c9fc4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:02.968326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:02.969035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:02.969327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:02.969609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:02.970570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:02.970885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:02.972824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:02.995763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 407/807] 10.222.0.41 () {56 vars in 1170 bytes} [Tue Nov 9 04:45:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:03.001379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.011165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0543dc-708b-450c-be82-14870a32f913 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.015610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.016420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.016707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.016988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.027927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:03.029772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:03.046953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:03.048528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 401/808] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:03.054657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.065103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbda78d-785e-4a7c-9674-2d5bdb5524aa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.069665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.070488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.070730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.071102 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.071880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:03.072238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:03.073905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:03.086021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 408/809] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:03.092327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.103083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62dc7b-0f4b-4395-a6d0-6e75f334f52c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.107825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.108655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.108950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.109234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.116546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:03.119153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:03.133184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:03.134703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 402/810] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:03.141058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.151271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3896f0c-5836-497f-b28b-cc0c735c8c4a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.156031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.156753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.157042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.157324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.158196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:03.158511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:03.160527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13279d-3520-4809-b4ae-2042787c3c8d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:03.174388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 409/811] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:45:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:03.181380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.191560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc9f30-730d-4f41-b6c2-4974e6bcf3f5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.196229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa86d-9817-4d80-806f-2cb5a07eb498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.197166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa86d-9817-4d80-806f-2cb5a07eb498 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.197450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa86d-9817-4d80-806f-2cb5a07eb498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.197728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa86d-9817-4d80-806f-2cb5a07eb498 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/65bdf4f5171f4c4e8a4eca9592fc880e/roles/16e746b24ea443cbb528d90400710aef` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.200108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54aa86d-9817-4d80-806f-2cb5a07eb498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=65bdf4f5171f4c4e8a4eca9592fc880e, role_id=16e746b24ea443cbb528d90400710aef)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:03.202866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54aa86d-9817-4d80-806f-2cb5a07eb498 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:03.219389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 403/812] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:45:03 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/65bdf4f5171f4c4e8a4eca9592fc880e/roles/16e746b24ea443cbb528d90400710aef => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:45:03.643363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bdb8b-e1db-49d0-bdc3-0f1fe3a598bc None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.643756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bdb8b-e1db-49d0-bdc3-0f1fe3a598bc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.643958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bdb8b-e1db-49d0-bdc3-0f1fe3a598bc None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.645989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 410/813] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:03.653167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df45da-7908-4bf4-802b-fe1bed531927 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.653467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df45da-7908-4bf4-802b-fe1bed531927 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.653754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df45da-7908-4bf4-802b-fe1bed531927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.672506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a1df45da-7908-4bf4-802b-fe1bed531927 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:03.673695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a1df45da-7908-4bf4-802b-fe1bed531927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:03.732022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 404/814] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:03 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:03.756168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bdb8b-e1db-49d0-bdc3-0f1fe3a598bc None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.770006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bdb8b-e1db-49d0-bdc3-0f1fe3a598bc None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.775615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788e199-81e3-4979-8f09-90989ecc81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.776700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788e199-81e3-4979-8f09-90989ecc81c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.777197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788e199-81e3-4979-8f09-90989ecc81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.777733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788e199-81e3-4979-8f09-90989ecc81c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.778762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788e199-81e3-4979-8f09-90989ecc81c6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:03.780776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788e199-81e3-4979-8f09-90989ecc81c6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:03.797713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 411/815] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:03 2021] POST /identity/v3/services => generated 241 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:03.902095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74a38-689d-427e-a333-7e37e15bdb01 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.902579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74a38-689d-427e-a333-7e37e15bdb01 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.902858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f74a38-689d-427e-a333-7e37e15bdb01 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.905085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 405/816] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:03.911588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.911916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.912191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:03.934781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:03.936060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:03.954195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 412/817] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:03 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:03.978699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f74a38-689d-427e-a333-7e37e15bdb01 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:03.991946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f74a38-689d-427e-a333-7e37e15bdb01 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:03.997197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:03.998427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:03.998962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:03.999441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.000398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.002281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.015331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 09 04:45:04.021788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 406/818] 10.222.0.41 () {56 vars in 1153 bytes} [Tue Nov 9 04:45:03 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:04.024319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.034498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77ee2c-87c8-434b-8e9c-af6da5e9e846 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.039414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.040142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.040430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.040711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.041443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:04.041754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.043346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.055231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 413/819] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:04.057031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.066905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a7054-67b6-4c79-bd83-ef44e34e6c96 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.072372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.073281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.073780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.074254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.075178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:04.075803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.077639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68efcfd-91ea-4210-affd-7d9a4de510a6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.087719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 407/820] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:04.090742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.100900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6032b5-38ba-4fdb-8fa9-0f870cb298fc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.106609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.107781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.108325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.108807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.109777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.110981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:45:04.110981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:45:04.110981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:45:04.112250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dfe0a-0e94-4a11-b1bd-f68a95dc8b08 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.139734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 414/821] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:45:04 2021] POST /identity/v3/endpoints => generated 347 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:04.594341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb2310-a6fe-43f8-a75e-6259781c9842 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.595326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb2310-a6fe-43f8-a75e-6259781c9842 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.595949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb2310-a6fe-43f8-a75e-6259781c9842 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.598981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 408/822] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:04 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:04.606092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.607000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.607558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.627330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:04.628926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:04.646287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 415/823] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:04 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:04.671313 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb2310-a6fe-43f8-a75e-6259781c9842 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.684685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb2310-a6fe-43f8-a75e-6259781c9842 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.689424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.690450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.690943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.691426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.692341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.694155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.705455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 09 04:45:04.707112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 409/824] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:04.713480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.722640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618453-6d48-4baf-b98d-2b7ea8069cd5 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.728708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.729605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.730126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.730608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.731548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:04.732108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.733918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.739332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 416/825] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:04.746309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.756609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f3fd0-12f2-4bb7-9585-a9cc9f7804ac admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.761370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.762253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.762740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.763231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.764197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:04.764722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.766499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.771964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 410/826] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:04.778471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.788306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7df27-a48c-4c0c-a277-a74a0684d332 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.793783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.794981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.795495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.796032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.797101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] RBAC: Adding query filter params (interface=public, service_id=d21b702c2a0948b2a994192b14e31381, region_id=RegionOne) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:04.797645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.799496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5a563-da7e-4b31-ae4a-868103fb9a9b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.805219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 417/827] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/endpoints?service_id=d21b702c2a0948b2a994192b14e31381&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:04.811960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:04.822269 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1c950-d55e-4374-bd65-0499378297b5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:04.827206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b593f-ba79-415f-8455-9a334d1d1d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:04.828151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b593f-ba79-415f-8455-9a334d1d1d10 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:04.828697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b593f-ba79-415f-8455-9a334d1d1d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:04.829231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b593f-ba79-415f-8455-9a334d1d1d10 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:04.830119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b593f-ba79-415f-8455-9a334d1d1d10 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:04.832033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b593f-ba79-415f-8455-9a334d1d1d10 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:04.839206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 411/828] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:45:04 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:45:05.611578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56529e0-f362-4d85-b98a-ab5ed690f5e0 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.612160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56529e0-f362-4d85-b98a-ab5ed690f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.612421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56529e0-f362-4d85-b98a-ab5ed690f5e0 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.614564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 418/829] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:05.621166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.621599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.621783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.640171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:05.641365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:05.649448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 412/830] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:05 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:05.673805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56529e0-f362-4d85-b98a-ab5ed690f5e0 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.686765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56529e0-f362-4d85-b98a-ab5ed690f5e0 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.691418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.692475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.692985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.693466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.703949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:05.712114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 09 04:45:05.713809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 419/831] 10.222.0.41 () {56 vars in 1141 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:05.720427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.729910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d59a4-c683-4c5e-b112-e871b0ad5e66 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.734762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.735710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.736214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.736703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.737694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:05.738210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:05.740086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:05.749914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 413/832] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:05.756280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.767464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185d8fc-a854-443a-882e-aa2e4c22e2ad admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.772456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.773497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.774022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.774506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.785256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:05.787380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:05.804649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:05.806928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 420/833] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:05.813365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.824070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ecf93-ae60-4b26-a1a4-e98ddb5e7ad4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.828964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.829894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.830384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.830881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.831873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:05.832383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:05.834197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:05.846904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 414/834] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:05.853304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.863227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5ed2-d4f0-49f1-ad53-ab7f7e4cb91a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.868614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.869669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.870239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.870745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.878557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:05.880871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:05.895947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 09 04:45:05.897641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 421/835] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:05.904111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.914268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c263fc9-107c-47be-a183-270e231cbafb admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.919204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.920439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.920930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.921426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.922474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:05.922997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:05.925061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:05.947941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 415/836] 10.222.0.41 () {56 vars in 1170 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:05.951012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:05.961019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cdd42-b144-41f0-9cb9-5b87164614ec admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:05.965980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:05.966905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:05.967457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:05.967981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:05.976720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:05.979331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:05.989012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 422/837] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:05.996091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.006577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeaf85-5af2-45ed-a106-dfa74957a386 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.012263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.013507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.014060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.014541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.028130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.030199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.050003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:06.051593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 416/838] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:06.058325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.067566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d369a3d-580f-4ad7-8713-7a9f791763d1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.072635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.073544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.074033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.074571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.075524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.076064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.077878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.090648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 423/839] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:06.097437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.108826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe09f-f580-4237-bf7a-147b0d0c144a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.113942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.115113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.115599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.116168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.123875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.126142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.140205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-e3b658f4-be3c-4045-94e4-2d1d8fc65c75 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:06.142043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 417/840] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:06.148880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.157390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d65c2-be43-4943-8133-c3cb865c0eb1 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.157685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d65c2-be43-4943-8133-c3cb865c0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.157964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d65c2-be43-4943-8133-c3cb865c0eb1 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.160016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 418/841] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:45:06.160591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00990-d82c-459c-83dd-684b65f35def admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.167472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.167793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.168083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.169241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.170427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.171089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.171728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.172896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.173459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.175720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.187351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:06.188585 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:06.190280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 424/842] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:06.196913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.201654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 419/843] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:06 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:06.207243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6556a-4b6d-42e5-8760-a64ac42a9f29 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.212545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.213485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.213992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.214522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.215686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] RBAC: Adding query filter params (role.id=16e746b24ea443cbb528d90400710aef, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=65bdf4f5171f4c4e8a4eca9592fc880e) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.216259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.218419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.225381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 425/844] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/role_assignments?user.id=65bdf4f5171f4c4e8a4eca9592fc880e&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=16e746b24ea443cbb528d90400710aef => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:06.231670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.236021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f517e-c16c-436d-9b90-bc89cb2270fb None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.241150 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.242136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.242531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.243480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.244461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.246268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.259097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 09 04:45:06.260716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 420/845] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:06.269880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.281511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5077e48-ad21-4216-ba94-2bc2e0cb459f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.285085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.286229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.286229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.286229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.286919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.287279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.288988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.295658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 426/846] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:06.302364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.313708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be99eb-1154-4063-9812-f7d78572f52f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.318584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.319323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.319629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.319921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.320792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.321154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.322891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.329143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 421/847] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:06.335769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.346323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08850dfe-6b8b-4929-a5ff-219ab986924d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.350985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.351677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.351966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.352827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.353649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] RBAC: Adding query filter params (interface=public, service_id=e7ee785f21074873a6e418da830d248e, region_id=RegionOne) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.353969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.355550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f822b-b066-4dce-8a2d-15ebb6b50149 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.361806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 427/848] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/endpoints?service_id=e7ee785f21074873a6e418da830d248e&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:06.368406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.379090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0f496-56f5-4b13-878a-3076ec4f7c70 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.384183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30e6ce-a917-40a4-9cdc-3e8a9fca7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.384961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30e6ce-a917-40a4-9cdc-3e8a9fca7600 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.385296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30e6ce-a917-40a4-9cdc-3e8a9fca7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.385576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30e6ce-a917-40a4-9cdc-3e8a9fca7600 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.386285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30e6ce-a917-40a4-9cdc-3e8a9fca7600 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.388044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f30e6ce-a917-40a4-9cdc-3e8a9fca7600 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.394871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 422/849] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:45:06.576805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4b57-88b0-4831-b845-a03b402dc23c None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.577124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4b57-88b0-4831-b845-a03b402dc23c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.577359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4b57-88b0-4831-b845-a03b402dc23c None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.579742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 428/850] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:06.586251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.586570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.586854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.607453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:06.609176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:06.623720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 423/851] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:06 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:06.642637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4b57-88b0-4831-b845-a03b402dc23c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.655933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4b57-88b0-4831-b845-a03b402dc23c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.660733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.661706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.662131 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.662543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.663344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.665132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.676832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 09 04:45:06.683716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 429/852] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services/compute => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:06.685806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.695244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9748f1-61d8-4a8f-b2d0-faa30d81b49b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.700499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.701340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.701776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.702192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.703047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.703494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.705247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21802b-3a51-4336-a309-ab5a96dffe5a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.715838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 424/853] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:06.717550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:06.728070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0649-be45-4d66-93d0-9bc4eb44ff79 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:06.732694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:06.733527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:06.733961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:06.734385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:06.735255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:06.735733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:06.737467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794b62a-38b8-4c66-88d7-ad4475f7839b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:06.747647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 430/854] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:06 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:07.212565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4845856-a106-4449-aa6d-d9d317b9c258 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:07.213251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4845856-a106-4449-aa6d-d9d317b9c258 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:07.213735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4845856-a106-4449-aa6d-d9d317b9c258 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:07.216070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 425/855] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:07.221816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:07.222111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:07.222454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:07.240405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:07.241578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:07.249527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 431/856] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:07 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:07.272807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4845856-a106-4449-aa6d-d9d317b9c258 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:07.285408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4845856-a106-4449-aa6d-d9d317b9c258 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:07.290280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:07.291064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:07.291341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:07.291608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:07.292288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:07.293858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:07.305156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 09 04:45:07.306567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 426/857] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:45:07 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:07.313105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:07.322116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4d814-3f70-44a2-b900-d63ff777d631 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:07.326585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:07.327249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:07.327529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:07.327834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:07.328556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:07.328862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:07.330523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:07.335834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 432/858] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:45:07 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:07.342814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:07.353378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f07455-2c01-4b42-966d-a378eccfcb1e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:07.358375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:07.359033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:07.359371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:07.359713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:07.360435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:07.360739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:07.362368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fd9558-46c0-4a2e-8d5f-e3dee7b47565 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:07.367651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 427/859] 10.222.0.41 () {56 vars in 1135 bytes} [Tue Nov 9 04:45:07 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:07.373942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:07.383875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50153585-17c1-4d75-bb95-e60c63e204f2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:07.388580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd07637-6099-412c-beaf-9ef7d89eb30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:07.389223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd07637-6099-412c-beaf-9ef7d89eb30b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:07.389556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd07637-6099-412c-beaf-9ef7d89eb30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:07.389832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd07637-6099-412c-beaf-9ef7d89eb30b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:07.390705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd07637-6099-412c-beaf-9ef7d89eb30b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:07.392379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd07637-6099-412c-beaf-9ef7d89eb30b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:07.413285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 433/860] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:45:07 2021] POST /identity/v3/endpoints => generated 346 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:45:08.610383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a920bf4-4f87-4248-b581-872c6e795b19 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.611065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a920bf4-4f87-4248-b581-872c6e795b19 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.611065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a920bf4-4f87-4248-b581-872c6e795b19 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.612990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 428/861] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:08.619733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403197d6-db97-405b-8b21-c5fbb8b32f89 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.620245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403197d6-db97-405b-8b21-c5fbb8b32f89 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.620408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403197d6-db97-405b-8b21-c5fbb8b32f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.638431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-403197d6-db97-405b-8b21-c5fbb8b32f89 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:08.639615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-403197d6-db97-405b-8b21-c5fbb8b32f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:08.657721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 434/862] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:08 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:08.681715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a920bf4-4f87-4248-b581-872c6e795b19 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.694011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a920bf4-4f87-4248-b581-872c6e795b19 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.698900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.699696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.699979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.700252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] PATH_INFO: `/v3/services/image` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.700984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.702563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.704749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7af0-e599-4168-8b8c-d0e13f89619a None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.705042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7af0-e599-4168-8b8c-d0e13f89619a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.705321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f7af0-e599-4168-8b8c-d0e13f89619a None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.707341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 435/863] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:45:08.713008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.713296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.713576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.713847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 09 04:45:08.715238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 429/864] 10.222.0.41 () {56 vars in 1126 bytes} [Tue Nov 9 04:45:08 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:08.722783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.731588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:08.733059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:08.734326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f60d76-69ef-44c3-a89b-68eb4cb2acde admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.738810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.739451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.739773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.740051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.740762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:08.741091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.743335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.743554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 436/865] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:08 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:08.748887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 430/866] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:08 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:08.756886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.768542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d074f-33d8-4d9c-bb88-f40e9689b6bc None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.773107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.773761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.774077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.774358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.775087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] RBAC: Adding query filter params (type=image) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:08.775393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.777051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.777515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.781992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 437/867] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:08 2021] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:08.788621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8791-452b-41b6-bcf5-a7a2aac49a3c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.793679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.794975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.795357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.795765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.796566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.798302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.811316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 09 04:45:08.812955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 431/868] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:08 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:08.821482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.832276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c12c9-ea88-4f9f-9201-67220a9dc7ff admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.837411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.838390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.838886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.839357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.840394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:08.840972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.842802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.849020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 438/869] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:08 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:08.856019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.866245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cf6b1-aad5-40b3-8cc0-c41e4be261ae admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.871634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.872322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.872607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.872880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.873614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:08.873919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.875525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4ba3-4b4a-4d11-9b25-fc016fd51631 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.881539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 432/870] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:08 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:08.888470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:08.898363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919cefe-b495-4401-8562-bf640ab9dca3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:08.903246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea70070-5958-4f2d-b091-04058467b87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:08.903987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70070-5958-4f2d-b091-04058467b87d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:08.904272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70070-5958-4f2d-b091-04058467b87d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:08.904604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea70070-5958-4f2d-b091-04058467b87d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:08.905391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70070-5958-4f2d-b091-04058467b87d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:08.907115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea70070-5958-4f2d-b091-04058467b87d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:08.932461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 439/871] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:45:08 2021] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:09.096241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014487de-efd3-43fb-bcd8-84c43b4fe9d2 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.096413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014487de-efd3-43fb-bcd8-84c43b4fe9d2 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.096773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014487de-efd3-43fb-bcd8-84c43b4fe9d2 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.099148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 433/872] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:09.106306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd784e0-d149-45b5-85c6-eaa9eeb2aec2 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.106617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd784e0-d149-45b5-85c6-eaa9eeb2aec2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.106875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd784e0-d149-45b5-85c6-eaa9eeb2aec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.127308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9fd784e0-d149-45b5-85c6-eaa9eeb2aec2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:09.128566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9fd784e0-d149-45b5-85c6-eaa9eeb2aec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:09.151771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 440/873] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:09 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:09.170298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014487de-efd3-43fb-bcd8-84c43b4fe9d2 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:09.184825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014487de-efd3-43fb-bcd8-84c43b4fe9d2 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:09.190177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:09.190840 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.191144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.191422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.192199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:09.193208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:45:09.193208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:45:09.193208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:45:09.194087 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee798e34-feae-4f83-8eee-713b73427087 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:09.210235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 434/874] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:09 2021] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:09.772759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf973e9-965f-4f1a-a323-a5a65b5f40ad None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.773272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf973e9-965f-4f1a-a323-a5a65b5f40ad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.773377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf973e9-965f-4f1a-a323-a5a65b5f40ad None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.775350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 441/875] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:09.781392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.781763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.781944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.800380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:09.801567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:09.818578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 435/876] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:09 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:09.842714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf973e9-965f-4f1a-a323-a5a65b5f40ad None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:09.855473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf973e9-965f-4f1a-a323-a5a65b5f40ad None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:09.860016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:09.860677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.860958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.861236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.862040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:09.863976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:09.865333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.common [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 09 04:45:09.888609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.sql.core [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 09 04:45:09.888609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 09 04:45:09.888609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [parameters: {'id': 'c591654907f84148bddd00c8eb21d239', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 09 04:45:09.888609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79031) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 09 04:45:09.904274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c591654907f84148bddd00c8eb21d239.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c591654907f84148bddd00c8eb21d239. Nov 09 04:45:09.906025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 442/877] 10.222.0.41 () {60 vars in 1161 bytes} [Tue Nov 9 04:45:09 2021] POST /identity/v3/projects => generated 262 bytes in 64 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:09.912206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:09.922230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00681e-45a4-4c32-89d0-7d2287c27355 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:09.926851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:09.927649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.927944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.928218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.935830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:09.937910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:09.952675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-bd69043e-1168-4cf4-916a-30939830e6c6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:09.954356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 436/878] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:09.961315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:09.973183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ec929-43ed-46b0-b561-82f53acb1118 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:09.978553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:09.979208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:09.979548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:09.979859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:09.980742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:09.981101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:09.983257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682cdc3-ec6c-459c-b39e-31deb9b43078 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:10.005278 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 443/879] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:09 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:11.116936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887c416-ea58-446e-bde6-34dfaaaea174 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.118486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887c416-ea58-446e-bde6-34dfaaaea174 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.118971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887c416-ea58-446e-bde6-34dfaaaea174 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.121222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 437/880] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:11.127507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d33937-f3f6-43f7-929e-0c964a65e41c None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.128376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d33937-f3f6-43f7-929e-0c964a65e41c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.128850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d33937-f3f6-43f7-929e-0c964a65e41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.148199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-99d33937-f3f6-43f7-929e-0c964a65e41c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:11.150194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-99d33937-f3f6-43f7-929e-0c964a65e41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:11.158929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 444/881] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:11 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:11.183906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887c416-ea58-446e-bde6-34dfaaaea174 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.198103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887c416-ea58-446e-bde6-34dfaaaea174 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.202828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8dd3-4c09-489a-bbdf-204f98103f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.203730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8dd3-4c09-489a-bbdf-204f98103f1a admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.204224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8dd3-4c09-489a-bbdf-204f98103f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.204713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8dd3-4c09-489a-bbdf-204f98103f1a admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.205666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8dd3-4c09-489a-bbdf-204f98103f1a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.207446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8dd3-4c09-489a-bbdf-204f98103f1a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.225394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 438/882] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:11 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:11.296955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb7e8-b677-48d7-ada0-5e7e205333e7 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.297268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb7e8-b677-48d7-ada0-5e7e205333e7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.297522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fb7e8-b677-48d7-ada0-5e7e205333e7 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.299635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 445/883] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:11.306148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.306433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.306717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.325790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:11.327006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:11.345484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 439/884] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:11 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:11.369834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb7e8-b677-48d7-ada0-5e7e205333e7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.385795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fb7e8-b677-48d7-ada0-5e7e205333e7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.390364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.391186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.391471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.391786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.392474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.394133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.407145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 09 04:45:11.408780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 446/885] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:11.415834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.425715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204074dc-94f7-4b56-9030-83e00c6db657 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.430988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.431712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.432067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.432351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.433109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:11.433417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.435082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.441276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 440/886] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:11.448438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.458488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a21cd-79be-4719-bdd1-e2a54b554c15 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.464504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.465195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.465483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.465762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.466489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:11.466797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.468431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.473773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 447/887] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:11.480520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.490258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6dbce-89c8-4ddb-bc05-697f3d1a9974 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.494874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.495526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.495844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.496179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.496992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] RBAC: Adding query filter params (interface=admin, service_id=e7ee785f21074873a6e418da830d248e, region_id=RegionOne) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:11.497308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.498897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f045e-778d-45b1-bffe-f0af5f5cffcb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.504724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 441/888] 10.222.0.41 () {56 vars in 1270 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/endpoints?service_id=e7ee785f21074873a6e418da830d248e&interface=admin®ion_id=RegionOne => generated 193 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:11.511776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.521567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c00ff-e9f1-49d6-a8fb-4c9c14ec42db admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.526339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77767593-e1a4-4808-8a1f-73d965badf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.527048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767593-e1a4-4808-8a1f-73d965badf50 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.527335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767593-e1a4-4808-8a1f-73d965badf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.527630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77767593-e1a4-4808-8a1f-73d965badf50 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.528391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77767593-e1a4-4808-8a1f-73d965badf50 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.530026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77767593-e1a4-4808-8a1f-73d965badf50 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.537268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 448/889] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:45:11.560099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c695fa-6145-4eb5-8416-1d3e3dcefa7f None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.560382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c695fa-6145-4eb5-8416-1d3e3dcefa7f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.560662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c695fa-6145-4eb5-8416-1d3e3dcefa7f None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.562863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 442/890] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:11.570769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.571062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.571344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.590644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:11.591878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:11.603719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 449/891] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:11 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:11.625242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c695fa-6145-4eb5-8416-1d3e3dcefa7f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.638287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c695fa-6145-4eb5-8416-1d3e3dcefa7f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.642884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.643717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.644000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.644272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.644943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.646544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.658626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 09 04:45:11.659887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 443/892] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:11.667602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.677521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d3f2-ec4d-4ebf-80d7-319d574f8597 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.682384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.683071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.683352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.683647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.684481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:11.684785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.686408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.692246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 450/893] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:11.698916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.709475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5afe0c-7427-4a0d-99e2-203307f6de56 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.714940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.715635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.715949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.716221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.717012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:11.717318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.719001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.730880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 444/894] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:11.732319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.742712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d23e8e-17dc-47cf-a675-3c12673ecc05 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.747518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.748214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.748548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.748831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.749875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] RBAC: Adding query filter params (interface=public, service_id=d988fe275eb945d99bd093fd407edc91, region_id=RegionOne) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:11.750187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.751872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499b657-9d04-41ce-97b5-16bef5ec730d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.763196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 451/895] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/endpoints?service_id=d988fe275eb945d99bd093fd407edc91&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:11.764632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:11.775911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a95e6-8d74-49c8-9fd6-eb1027364502 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:11.780610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa57b8f-353d-40c3-b7dc-98f1d031da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:11.781301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57b8f-353d-40c3-b7dc-98f1d031da89 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:11.781589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57b8f-353d-40c3-b7dc-98f1d031da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:11.781862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa57b8f-353d-40c3-b7dc-98f1d031da89 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:11.782610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa57b8f-353d-40c3-b7dc-98f1d031da89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:11.784286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa57b8f-353d-40c3-b7dc-98f1d031da89 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:11.795173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 445/896] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:45:11 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:45:12.370850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427c0d-269d-49cb-b475-9b2d17ad5d3a None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:12.371543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427c0d-269d-49cb-b475-9b2d17ad5d3a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:12.371543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3427c0d-269d-49cb-b475-9b2d17ad5d3a None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:12.373470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 452/897] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:12.379519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:12.380032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:12.380182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:12.397966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:12.400014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:12.408278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 446/898] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:12 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:12.434163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3427c0d-269d-49cb-b475-9b2d17ad5d3a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:12.446408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3427c0d-269d-49cb-b475-9b2d17ad5d3a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:12.450793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:12.451455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:12.451800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:12.452081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:12.452808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:12.454632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:12.469866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.sql.core [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 09 04:45:12.469866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 09 04:45:12.469866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [parameters: {'user_id': '38a9bdff8c974bbdb304a4a91092b370', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 09 04:45:12.469866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79031) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 09 04:45:12.475953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 09 04:45:12.478142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 453/899] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:45:12 2021] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:12.484634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:12.493972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f092745-7494-4042-80fe-0d5313cd75a7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:12.498915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:12.499838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:12.500131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:12.500403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:12.508928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:12.510977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:12.529448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-8e2b88aa-ceea-403a-b463-a3d467c7e9ed admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 09 04:45:12.530989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 447/900] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:12 2021] GET /identity/v3/users/cinder => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:12.537376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:12.558249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8701-2032-4c01-9f35-c823833bcfd6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:12.563137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:12.566279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:12.566279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:12.566279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:12.566279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:12.566279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:12.567915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93f236-3ffd-4448-bd71-1249380bec61 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:12.608569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 454/901] 10.222.0.41 () {56 vars in 1122 bytes} [Tue Nov 9 04:45:12 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:13.573584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0cc75-3412-4294-9664-3132b92cf866 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.574125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0cc75-3412-4294-9664-3132b92cf866 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.574125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0cc75-3412-4294-9664-3132b92cf866 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.576510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 448/902] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:13.583710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.584109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.584303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.602527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:13.604072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:13.611908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 455/903] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:13 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:13.635575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0cc75-3412-4294-9664-3132b92cf866 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:13.647422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0cc75-3412-4294-9664-3132b92cf866 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:13.652317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:13.653096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.653367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.653641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.654306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:13.655904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:13.666374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 09 04:45:13.667706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 449/904] 10.222.0.41 () {56 vars in 1126 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/services/image => generated 86 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:13.674362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:13.683197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180446-a653-4a41-ba8c-df0b382c3cce None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:13.687593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:13.688279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.688564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.688843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.689565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:13.689871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:13.691470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:13.697030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 456/905] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:13.702972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:13.713330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf688bd-9fa9-4c62-b07c-14c42529f270 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:13.717926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:13.718571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.718852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.719126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.719868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:13.720173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:13.721775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:13.726700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 450/906] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:13.733449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:13.743734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb3cd2-467f-44c8-bc12-107efaf963d3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:13.748684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:13.749381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.749666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.749945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.750777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] RBAC: Adding query filter params (interface=public, service_id=64bc3aee0f37444b932ddd015f39b8fd, region_id=RegionOne) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:13.751092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:13.752789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ee9e-ebce-4f42-acb2-f2aa3e5d144e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:13.759342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 457/907] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/endpoints?service_id=64bc3aee0f37444b932ddd015f39b8fd&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:13.766192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:13.777033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5746c8ec-1afb-42b8-9da9-ac1c6918d8c5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:13.781582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce756b9f-5e27-42c0-bca2-09d3b95b1180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:13.782240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce756b9f-5e27-42c0-bca2-09d3b95b1180 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.782524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce756b9f-5e27-42c0-bca2-09d3b95b1180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.782800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce756b9f-5e27-42c0-bca2-09d3b95b1180 admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.783490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce756b9f-5e27-42c0-bca2-09d3b95b1180 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:13.785099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce756b9f-5e27-42c0-bca2-09d3b95b1180 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:13.791861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 451/908] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:45:13.885731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2540d5-7d5f-4b9f-9781-1f75faa10024 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.886053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2540d5-7d5f-4b9f-9781-1f75faa10024 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.886293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2540d5-7d5f-4b9f-9781-1f75faa10024 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.888285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 458/909] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:13.894445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.894734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.895010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.913534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:13.914775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:13.922951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 452/910] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:13 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:13.947941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2540d5-7d5f-4b9f-9781-1f75faa10024 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:13.963988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2540d5-7d5f-4b9f-9781-1f75faa10024 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:13.969448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:13.970292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:13.970582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:13.970944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:13.971700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:13.973459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:13.985785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 09 04:45:13.987196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 459/911] 10.222.0.41 () {56 vars in 1147 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:13.994360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.003587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fb4c3-2fb2-4e0b-a959-3fdf4a90543c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.008935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.009606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.009885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.010170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.010887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:14.011193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.012812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.018799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 453/912] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:13 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:14.025345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.036608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121eb10-ca10-4376-ac35-b7396534d7e3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.041255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.041922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.042215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.042498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.043230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:14.043542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.045436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61f49c-37d7-4d70-ade3-2839820aa579 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.050716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 460/913] 10.222.0.41 () {56 vars in 1143 bytes} [Tue Nov 9 04:45:14 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:14.057699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.067315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c4e20-ee8b-43bd-a30e-fd0fbf00277d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.072641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5ec58-f082-4a91-ab6a-03d87108d7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.073319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ec58-f082-4a91-ab6a-03d87108d7ad admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.073609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ec58-f082-4a91-ab6a-03d87108d7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.073891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5ec58-f082-4a91-ab6a-03d87108d7ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.074660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5ec58-f082-4a91-ab6a-03d87108d7ad admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.076284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5ec58-f082-4a91-ab6a-03d87108d7ad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.090955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 454/914] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:45:14 2021] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:45:14.094031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18486a3b-b88a-4dc0-8359-a2719fece0aa None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.094330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18486a3b-b88a-4dc0-8359-a2719fece0aa None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.094619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18486a3b-b88a-4dc0-8359-a2719fece0aa None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.098044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 461/915] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:45:14.103568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.104015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.104335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.123817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:14.125044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:14.143915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 455/916] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:14 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:14.168031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18486a3b-b88a-4dc0-8359-a2719fece0aa None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.182415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18486a3b-b88a-4dc0-8359-a2719fece0aa None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.187891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.188788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.189112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.189436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.190295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.192357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.204896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 09 04:45:14.206333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 462/917] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:14 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:14.213387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.222989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff229f-b961-4110-9434-926e464a02e9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.228412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.229215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.229572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.230059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.230916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:14.231302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.232973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.238877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 456/918] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:14 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:14.245796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.256381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a4923-2115-450d-89d4-da33a55ada5c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.261126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.261808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.262121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.262383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.263130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:14.263444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.265099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cb596-aedf-4d4b-a483-9f1f64d2c679 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.270970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 463/919] 10.222.0.41 () {56 vars in 1133 bytes} [Tue Nov 9 04:45:14 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:14.277392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:14.287654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875bdf4f-0864-44bf-bc92-6b823f4babac admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:14.292791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600ad14-1bf1-4d1f-b4f6-aa8fa0701ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:14.293458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ad14-1bf1-4d1f-b4f6-aa8fa0701ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:14.293748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ad14-1bf1-4d1f-b4f6-aa8fa0701ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:14.294028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600ad14-1bf1-4d1f-b4f6-aa8fa0701ce3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:14.295055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600ad14-1bf1-4d1f-b4f6-aa8fa0701ce3 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:14.296674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600ad14-1bf1-4d1f-b4f6-aa8fa0701ce3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:14.317581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 457/920] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:45:14 2021] POST /identity/v3/endpoints => generated 334 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:45:16.060726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7555ea-243b-4860-9eb0-e2d195eb2105 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.061231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7555ea-243b-4860-9eb0-e2d195eb2105 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.061306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7555ea-243b-4860-9eb0-e2d195eb2105 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.063028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 464/921] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:16.069091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.069541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.069678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.088190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:16.089374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:16.105797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 458/922] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:16 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:16.130661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7555ea-243b-4860-9eb0-e2d195eb2105 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.143327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7555ea-243b-4860-9eb0-e2d195eb2105 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.147700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.148481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.148795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.149191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.149867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.151451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.162102 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 09 04:45:16.163381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 465/923] 10.222.0.41 () {56 vars in 1126 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:16.170156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.179108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2092b29-98b3-4b76-818d-17d1a46b2cb7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.184113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.184842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.185195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.185540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.186361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] RBAC: Adding query filter params (name=image) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:16.186743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.188460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.193686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 459/924] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:16.200717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.210443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9715d6-685b-462b-a97f-f29bd93ad6e8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.215061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.215743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.216035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.216316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.217041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:16.217353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.218949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca79214-9b2d-43d4-8058-bbf6ac5dd484 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.223982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 466/925] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:16.230225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.239970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135963d-6af5-40f8-b87e-3803b4fd80ad admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.245089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f8f7f-6bea-4a5f-be40-b73d6cc30c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.245843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f8f7f-6bea-4a5f-be40-b73d6cc30c54 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.246132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f8f7f-6bea-4a5f-be40-b73d6cc30c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.246415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f8f7f-6bea-4a5f-be40-b73d6cc30c54 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.247183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f8f7f-6bea-4a5f-be40-b73d6cc30c54 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.248813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f8f7f-6bea-4a5f-be40-b73d6cc30c54 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.275112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 460/926] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:45:16 2021] POST /identity/v3/endpoints => generated 327 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:45:16.407714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fe6c0-e43e-4913-862c-341d0f662b71 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.408070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fe6c0-e43e-4913-862c-341d0f662b71 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.408287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fe6c0-e43e-4913-862c-341d0f662b71 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.410269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 467/927] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:16.416737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.417047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.417303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.436459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:16.437675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:16.456574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 461/928] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:16.481980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fe6c0-e43e-4913-862c-341d0f662b71 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.494800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fe6c0-e43e-4913-862c-341d0f662b71 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.499246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1043b2-6756-47a4-916e-809da21206a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.500055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1043b2-6756-47a4-916e-809da21206a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.500344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1043b2-6756-47a4-916e-809da21206a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.500629 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1043b2-6756-47a4-916e-809da21206a4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.501806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1043b2-6756-47a4-916e-809da21206a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.503486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1043b2-6756-47a4-916e-809da21206a4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.505289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 468/929] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:16.511540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.521657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666bd61-459a-40a5-99e1-11c4196fa25d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.526421 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1072a074-8122-48fd-9ded-fc563f0c6274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.527119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a074-8122-48fd-9ded-fc563f0c6274 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.527392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a074-8122-48fd-9ded-fc563f0c6274 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.527758 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1072a074-8122-48fd-9ded-fc563f0c6274 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.528482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a074-8122-48fd-9ded-fc563f0c6274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.530472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1072a074-8122-48fd-9ded-fc563f0c6274 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.561752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 462/930] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:16 2021] POST /identity/v3/projects => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:16.679070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec873-b9d2-4a94-a1a5-3a97a2bbd76d None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.679383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec873-b9d2-4a94-a1a5-3a97a2bbd76d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.679579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ec873-b9d2-4a94-a1a5-3a97a2bbd76d None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.682127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 469/931] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:16.688487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.688786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.689052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.707261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:16.708506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:16.767919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 463/932] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:16.792354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec873-b9d2-4a94-a1a5-3a97a2bbd76d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.805453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ec873-b9d2-4a94-a1a5-3a97a2bbd76d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.809996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.810792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.811088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.811373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.822283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:16.829450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 09 04:45:16.830771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 470/933] 10.222.0.41 () {56 vars in 1141 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:16.837753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.846773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b5264-7e21-4b4f-9dc8-aedfae7aa4dd None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.851553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.852932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.853220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.853500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.854266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:16.854573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.856200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.864253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 464/934] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:16.870853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.880352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5fc29-6499-4ca0-8891-85576f1f663f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.884867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.885705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.885992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.886276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.896086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.897911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.915417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:16.916895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 471/935] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:16.923312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.933064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d7f00-e484-4e04-b351-f1e49198f4a9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.937603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.938306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.938588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.938862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.939692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:16.939967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.941691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:16.954515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 465/936] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:16.960497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:16.970415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb856fd-095c-4537-ab49-f8ae05ab69c7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:16.974752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:16.975518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:16.975836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:16.976113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:16.983892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:16.985949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.001530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:45:17.002859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 472/937] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:45:16 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:17.009060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.018841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fb88-f18d-47f0-83b3-139bf88a2923 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.023455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.024719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.025076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.025427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.026363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:17.026744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.028688 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.046797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 466/938] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:17.052952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.062581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a950b-1fd6-474a-b32f-9e0b54960749 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.067132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.067836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.068123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.068399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.076097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.077829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.087193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 473/939] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:17.093310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.103468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4aeac1-f8c0-4552-b5bb-42472be4d49e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.108199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.109130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.109523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.109898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.119963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.121886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.138133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:17.139547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 467/940] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:17.146103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.155440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e17dc-6b83-4e6e-91e1-9e5e26df3971 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.160086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.160738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.161025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.161304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.162043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:17.162355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.164883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.176767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 474/941] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:17.182980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.193345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff67c7-667b-4e94-a8b1-fab8b9e4bd26 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.198492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.199268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.199556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.199867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.206786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.208917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.222407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:17.223739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 468/942] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:17.229992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.239737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ca89f-0c13-4960-af80-baeb7640681a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.244319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.245076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.245460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.245836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.246740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:17.247154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.249116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9a7fb-7014-4107-9936-d79269994b5f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.261643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 475/943] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:17.268331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:17.279216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f075010-da72-4faa-b1a3-f48ab63f3292 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:17.283741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:17.284474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:17.284857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:17.285230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:17.286164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] RBAC: Adding query filter params (role.id=16e746b24ea443cbb528d90400710aef, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=c16b11a1bbac45c0b869734149bd3416) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:17.286578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:17.288536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1a2df-b894-44ec-a30e-82e34698eb10 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:17.293910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 469/944] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:17 2021] GET /identity/v3/role_assignments?user.id=c16b11a1bbac45c0b869734149bd3416&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=16e746b24ea443cbb528d90400710aef => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:18.568681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecffeb3-c0d5-47ec-bff8-0df53dbc6472 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.568681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecffeb3-c0d5-47ec-bff8-0df53dbc6472 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.568681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecffeb3-c0d5-47ec-bff8-0df53dbc6472 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.571197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 476/945] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:18.577088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.577477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.577633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.594346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:18.595508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:18.603136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 470/946] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:18.626447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecffeb3-c0d5-47ec-bff8-0df53dbc6472 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:18.638789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecffeb3-c0d5-47ec-bff8-0df53dbc6472 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:18.642991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e2f43-e550-496b-ab66-526e9e7e977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:18.643636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e2f43-e550-496b-ab66-526e9e7e977a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.643938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e2f43-e550-496b-ab66-526e9e7e977a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.644213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e2f43-e550-496b-ab66-526e9e7e977a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.651590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e2f43-e550-496b-ab66-526e9e7e977a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:18.653331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e2f43-e550-496b-ab66-526e9e7e977a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:18.661921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 477/947] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:18 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:18.668129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:18.677041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e354b0-b8e9-4e4b-8a60-fa35e2dd2637 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:18.682014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80604a8-2b2c-43c2-9ba9-a35c3c41ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:18.682791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80604a8-2b2c-43c2-9ba9-a35c3c41ddee admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.683071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80604a8-2b2c-43c2-9ba9-a35c3c41ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.683339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80604a8-2b2c-43c2-9ba9-a35c3c41ddee admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.684551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80604a8-2b2c-43c2-9ba9-a35c3c41ddee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:18.686232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80604a8-2b2c-43c2-9ba9-a35c3c41ddee admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:18.688080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 471/948] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:18.907323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6bd02-eb65-41c8-84e2-cf810f7fe0fa None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.907638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6bd02-eb65-41c8-84e2-cf810f7fe0fa None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.907927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6bd02-eb65-41c8-84e2-cf810f7fe0fa None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.909711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 478/949] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:18.916485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.916780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.917067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.935873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:18.937093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:18.945078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 472/950] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:18.970388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6bd02-eb65-41c8-84e2-cf810f7fe0fa None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:18.983390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6bd02-eb65-41c8-84e2-cf810f7fe0fa None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:18.987937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5431-5718-4130-8087-0eb42dd1933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:18.988728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5431-5718-4130-8087-0eb42dd1933d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:18.989013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5431-5718-4130-8087-0eb42dd1933d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:18.989291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5431-5718-4130-8087-0eb42dd1933d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:18.990521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5431-5718-4130-8087-0eb42dd1933d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:18.992193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5431-5718-4130-8087-0eb42dd1933d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:18.994056 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 479/951] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:19.000287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.010150 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594eecc-c0a1-4f15-b74b-03b45b15a4ff None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.014795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5d7bf-c66c-459a-9699-30b5316d1a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.015464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5d7bf-c66c-459a-9699-30b5316d1a49 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.015840 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5d7bf-c66c-459a-9699-30b5316d1a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.016122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5d7bf-c66c-459a-9699-30b5316d1a49 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.016873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5d7bf-c66c-459a-9699-30b5316d1a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.018792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5d7bf-c66c-459a-9699-30b5316d1a49 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.039423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 473/952] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:45:18 2021] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:19.525822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7446da-63c0-49d7-b7e4-f9ac7dd6511a None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.526182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7446da-63c0-49d7-b7e4-f9ac7dd6511a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.526466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7446da-63c0-49d7-b7e4-f9ac7dd6511a None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.528263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 480/953] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:19.534191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.534482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.534759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.552574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:19.553743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:19.561867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 474/954] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:19.584556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7446da-63c0-49d7-b7e4-f9ac7dd6511a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.596389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7446da-63c0-49d7-b7e4-f9ac7dd6511a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.600605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.601382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.602182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.602455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.612150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:19.619816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 09 04:45:19.620924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 481/955] 10.222.0.41 () {56 vars in 1141 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:19.627189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.635966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0eb13-b832-41d6-9e3d-b23de6d17a33 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.640440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.641169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.641516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.641866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.642686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:19.642997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.644590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.652350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 475/956] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:19.658238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.668522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e36e-996c-444b-bfea-6248bdc98680 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.673142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.673889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.674172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.674447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.684757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.686566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.703191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:19.704404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 482/957] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:19.710880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.720561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4126926-5718-436e-9e06-2ca329cfdec8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.724963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.725615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.725898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.726175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.727439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:19.727854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.729419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.740876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 476/958] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:19.747648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.757051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683eff1-0c2c-4080-a778-691d7b62052a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.761525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.762296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.762577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.762853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.769874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.771890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.784965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:45:19.786040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 483/959] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/users/nova => generated 82 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:19.792846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.802474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce373d-f6f2-4b71-bfef-ae595a2ddafd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.807427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.808113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.808407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.808666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.809500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:19.809804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.811611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.828402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 477/960] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:19.834522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.844527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8849-e8a2-4cb3-8305-c7edccf7ae66 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.848944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.849716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.849999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.850275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.868172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.870004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.886243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:19.887408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 484/961] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:19.893691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.903734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66353f-f9ad-42fd-b4c1-6d147acf1ce3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.908175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.908819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.909101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.909373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.910098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:19.910401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.911993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.923781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 478/962] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:19.930095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.939820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f2053f-82e5-4f0c-bfa7-fbb640ee1883 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.944241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.945010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.945300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.945579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.952408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.954359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:19.967420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:19.968591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 485/963] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:19.975050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:19.985069 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0ca98-e646-46cf-80df-cca115b3f1db admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:19.989661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:19.990322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:19.990605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:19.990879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:19.991723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:19.992035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:19.993885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde9929-166f-4f4c-b4b7-ec9cae05a224 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:20.005620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 479/964] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:45:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:20.012445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:20.022814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ee88-7038-4eac-905b-4dfb5b074f5c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:20.027959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867982a6-a413-4919-884f-1cbba5304c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:20.029052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867982a6-a413-4919-884f-1cbba5304c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:20.029339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867982a6-a413-4919-884f-1cbba5304c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:20.029613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867982a6-a413-4919-884f-1cbba5304c0b admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/c16b11a1bbac45c0b869734149bd3416/roles/16e746b24ea443cbb528d90400710aef` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:20.031848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867982a6-a413-4919-884f-1cbba5304c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=c16b11a1bbac45c0b869734149bd3416, role_id=16e746b24ea443cbb528d90400710aef)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:20.034756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867982a6-a413-4919-884f-1cbba5304c0b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:20.053659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 486/965] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:45:20 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/c16b11a1bbac45c0b869734149bd3416/roles/16e746b24ea443cbb528d90400710aef => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:45:21.375568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb20280-dfeb-45e4-9091-f3057591ba3e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.376143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb20280-dfeb-45e4-9091-f3057591ba3e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.376143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb20280-dfeb-45e4-9091-f3057591ba3e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.377916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 480/966] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:21.384575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.384977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.385331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.402026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:21.403183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:21.458294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 487/967] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:21.482670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb20280-dfeb-45e4-9091-f3057591ba3e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:21.495802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb20280-dfeb-45e4-9091-f3057591ba3e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:21.500096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:21.500885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.501167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.501440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.512240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:21.519025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:45:21.520230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 481/968] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:45:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:45:21.526955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:21.535670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341133c-a438-46df-a14b-91cb9c6d87bf None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:21.540045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:21.540751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.541034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.541309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.542065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:21.542368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:21.543972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:21.552939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 488/969] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:21.559303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:21.569405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b15c51-ede0-4d0a-a405-f6454f0d84c1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:21.574473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:21.575371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.575757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.576098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] PATH_INFO: `/v3/users/8cba3e20e5e6412a9df321ff96021ce0` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.588954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] RBAC: Authorizing `identity:get_user(user_id=8cba3e20e5e6412a9df321ff96021ce0)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:21.591065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:21.592703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 482/970] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:21 2021] GET /identity/v3/users/8cba3e20e5e6412a9df321ff96021ce0 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:21.599039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:21.608504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dcc8ed-9587-4380-aed5-cbefff6749e6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:21.613024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:21.613727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.614081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.614444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.622515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:21.624289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:21.633456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 489/971] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:21.639301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:21.648372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec981d4-54b8-4bd2-aa7d-10c582117a93 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:21.652703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ea851-5616-42fe-b4c7-f4153316c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:21.653515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ea851-5616-42fe-b4c7-f4153316c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.653794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ea851-5616-42fe-b4c7-f4153316c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.654068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ea851-5616-42fe-b4c7-f4153316c8e5 admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.655215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ea851-5616-42fe-b4c7-f4153316c8e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:21.657224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ea851-5616-42fe-b4c7-f4153316c8e5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:21.658797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 483/972] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:21 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:21.665052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:21.673814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742fb044-2a7e-4943-bbaa-c627090a12a1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:21.678257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:21.678876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:21.679159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:21.679434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:21.680777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=544e6da2df684d0e97130d11c4954cc8, user.id=8cba3e20e5e6412a9df321ff96021ce0) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:21.681087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:21.682867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3591575-63d6-4afb-87a5-766297cd9e3c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:21.695913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 490/973] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:21 2021] GET /identity/v3/role_assignments?user.id=8cba3e20e5e6412a9df321ff96021ce0&scope.project.id=544e6da2df684d0e97130d11c4954cc8&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:22.403898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bced8-2707-4b00-b2c8-aa473f9d8180 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.404459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bced8-2707-4b00-b2c8-aa473f9d8180 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.404459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bced8-2707-4b00-b2c8-aa473f9d8180 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.406223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 484/974] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:22.412175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.412591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.412737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.431009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:22.432208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:22.439667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 491/975] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:22.464622 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bced8-2707-4b00-b2c8-aa473f9d8180 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.476533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bced8-2707-4b00-b2c8-aa473f9d8180 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.480867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.481652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.481935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.482210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.492100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:22.499252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 09 04:45:22.500566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 485/976] 10.222.0.41 () {56 vars in 1141 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:22.506856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.516678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c229e-12e3-4e1d-b9e1-a363a0a33a62 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.521184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.521838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.522123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.522398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.523159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:22.524036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.525634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.533602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 492/977] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:22.539896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.550162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c93a32-b5e4-4474-9164-382c53fe74ae admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.554670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.555439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.555750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.556021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.566225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.568467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.584792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:22.591687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 486/978] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:22.592899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.602764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbbab03-9613-47ec-a695-b40213d0af23 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.607183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.607868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.608155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.608435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.609174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:22.609481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.611057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.622345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 493/979] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:22.628384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.638256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291870a-4220-4199-aa50-62e989f43c21 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.642646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.643406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.643716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.643994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.651591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.653601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.667579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 09 04:45:22.671654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 487/980] 10.222.0.41 () {56 vars in 1114 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:22.675223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.684668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f3d98-fbdc-4990-a49c-444a3cf2e86b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.689137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.689793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.690071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.690346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.691191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:22.691500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.693370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.710490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 494/981] 10.222.0.41 () {56 vars in 1154 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:22.717299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.726631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd38e7-6108-459c-9409-4f8136084077 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.731014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.731664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.731946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.732217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.739687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.741409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.749952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 488/982] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:45:22.756444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.766481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b3b7a-44de-48ce-b8c9-be170a536c7a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.770939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.771754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.772040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.772313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.782713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.784591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.800811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:45:22.801968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 495/983] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:22.808834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.817483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47259fbe-6505-4092-b652-b25fc18aac24 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.822506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.823149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.823423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.823726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.824460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:22.824761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.826316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.837750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 489/984] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:22.844182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.854418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4b6f3-cfe8-40c2-a6d2-c1f749257040 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.858996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.859827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.860110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.860383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.867965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.869935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.882419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:45:22.884127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 496/985] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:22.890693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.900205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be55dc-5d06-4bc9-8f41-4fe4bf1b3163 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.904653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.905300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.905587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.905872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.906666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:22.906987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.908848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67df41-8e36-48ac-88a8-266a3beb0d7e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.921243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 490/986] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:22.927501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:22.939184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95303c3-63d4-45bd-83a0-5435cf39286a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:22.943662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:22.944302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:22.944588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:22.944864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:22.946276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] RBAC: Adding query filter params (role.id=16e746b24ea443cbb528d90400710aef, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=c16b11a1bbac45c0b869734149bd3416) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:22.946592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:22.948448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b42eba9-a4f4-4a8c-b4f9-cbaec1e149e4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:22.954153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 497/987] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:22 2021] GET /identity/v3/role_assignments?user.id=c16b11a1bbac45c0b869734149bd3416&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=16e746b24ea443cbb528d90400710aef => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:23.951929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a375-0efd-40c5-8426-cd3d3f87633a None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:23.952462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a375-0efd-40c5-8426-cd3d3f87633a None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:23.952462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a375-0efd-40c5-8426-cd3d3f87633a None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:23.954236 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 491/988] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:23.960209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:23.960622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:23.960775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:23.977945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:23.979119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:23.986585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 498/989] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:24.010196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a375-0efd-40c5-8426-cd3d3f87633a None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:24.022044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a375-0efd-40c5-8426-cd3d3f87633a None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:24.026263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:24.027019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:24.027298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:24.027570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:24.037276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:24.044699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:45:24.045807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 492/990] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:45:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:24.052621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:24.062216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89846c0-f786-4618-9771-15e79ac874c9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:24.066912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:24.067563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:24.067879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:24.068161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:24.069233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:24.069801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:24.071701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:24.080250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 499/991] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:24.086602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:24.096359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16dde5-afff-44cf-92e0-ededea96d1c1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:24.100707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:24.102059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:24.102336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:24.102608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] PATH_INFO: `/v3/users/8cba3e20e5e6412a9df321ff96021ce0` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:24.103823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] RBAC: Authorizing `identity:get_user(user_id=8cba3e20e5e6412a9df321ff96021ce0)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:24.105914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:24.107436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 493/992] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:24 2021] GET /identity/v3/users/8cba3e20e5e6412a9df321ff96021ce0 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:24.113244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:24.122941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f70a25-77f8-48fc-9f16-5588c7bd57e5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:24.127327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0997f1-e41f-4d1d-9d67-4f58990c4dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:24.128195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0997f1-e41f-4d1d-9d67-4f58990c4dec admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:24.128479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0997f1-e41f-4d1d-9d67-4f58990c4dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:24.128757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0997f1-e41f-4d1d-9d67-4f58990c4dec admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:24.129924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0997f1-e41f-4d1d-9d67-4f58990c4dec admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:24.131945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0997f1-e41f-4d1d-9d67-4f58990c4dec admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:24.133528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 500/993] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:24 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:24.139398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:24.148396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f32772d-239d-4944-93c2-e10bad8fb627 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:24.152756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acde0e-a58d-459a-97ae-21b3a68ec62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:24.153565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acde0e-a58d-459a-97ae-21b3a68ec62a admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:24.153844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acde0e-a58d-459a-97ae-21b3a68ec62a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:24.154115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acde0e-a58d-459a-97ae-21b3a68ec62a admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8/users/8cba3e20e5e6412a9df321ff96021ce0/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:24.156038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acde0e-a58d-459a-97ae-21b3a68ec62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=544e6da2df684d0e97130d11c4954cc8, user_id=8cba3e20e5e6412a9df321ff96021ce0, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:24.158646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37acde0e-a58d-459a-97ae-21b3a68ec62a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:24.171484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 494/994] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:45:24 2021] PUT /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8/users/8cba3e20e5e6412a9df321ff96021ce0/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:45:26.365789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fe0a0-8be5-4b64-afa8-3c55ae423fe1 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.366351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fe0a0-8be5-4b64-afa8-3c55ae423fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.366351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fe0a0-8be5-4b64-afa8-3c55ae423fe1 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.368152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 501/995] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:26.374171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.374609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.374788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.392301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:26.393463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:26.447809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 495/996] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:26.472270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fe0a0-8be5-4b64-afa8-3c55ae423fe1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:26.484092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fe0a0-8be5-4b64-afa8-3c55ae423fe1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:26.488382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:26.489146 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.489432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.489711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.502267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:26.509486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:45:26.510621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 502/997] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:45:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:26.517339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:26.526708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ba81a-ed0a-4edb-85da-49443fd27471 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:26.531114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:26.531789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.532070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.532340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.533089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:26.533389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:26.534956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:26.542741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 496/998] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:26.549065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:26.559217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec77f8f-2e47-4af7-9ca7-4de72cebe09b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:26.563709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:26.564558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.564844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.565124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] PATH_INFO: `/v3/users/8cba3e20e5e6412a9df321ff96021ce0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.566341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] RBAC: Authorizing `identity:get_user(user_id=8cba3e20e5e6412a9df321ff96021ce0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:26.568487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:26.570562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 503/999] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:26 2021] GET /identity/v3/users/8cba3e20e5e6412a9df321ff96021ce0 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:26.576886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:26.586828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b903d-7cc3-4c82-9656-92a6c83c12c7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:26.591268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:26.591924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.592207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.592483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.599821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:26.601564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:26.609901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 497/1000] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:26.616002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:26.625675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b687e-0acf-48fe-9eb0-3de3e2954759 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:26.630086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fb606b-c6d3-4afc-98bf-a3393a4de52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:26.630896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb606b-c6d3-4afc-98bf-a3393a4de52c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.631176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb606b-c6d3-4afc-98bf-a3393a4de52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.631475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fb606b-c6d3-4afc-98bf-a3393a4de52c admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.633207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb606b-c6d3-4afc-98bf-a3393a4de52c admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:26.635197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fb606b-c6d3-4afc-98bf-a3393a4de52c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:26.636839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 504/1001] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:26 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:26.642970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:26.651243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba039c87-055a-40af-aa7e-9095c63e1090 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:26.655791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:26.656401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:26.656683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:26.656959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:26.657779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=544e6da2df684d0e97130d11c4954cc8, user.id=8cba3e20e5e6412a9df321ff96021ce0) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:26.658092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:26.659891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d80b9fe-5969-4579-b0a7-501353204a02 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:26.665450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 498/1002] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:26 2021] GET /identity/v3/role_assignments?user.id=8cba3e20e5e6412a9df321ff96021ce0&scope.project.id=544e6da2df684d0e97130d11c4954cc8&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:28.894657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1185cf-7682-4f43-9899-a69e450ac99e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:28.895168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1185cf-7682-4f43-9899-a69e450ac99e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:28.895284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1185cf-7682-4f43-9899-a69e450ac99e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:28.896995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 505/1003] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:28.903462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:28.903864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:28.904061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:28.921928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:28.923097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:28.930595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 499/1004] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:28.955252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1185cf-7682-4f43-9899-a69e450ac99e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:28.967362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1185cf-7682-4f43-9899-a69e450ac99e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:28.971593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c040a98-bf32-4b08-a499-b6dac0021134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:28.972394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c040a98-bf32-4b08-a499-b6dac0021134 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:28.972677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c040a98-bf32-4b08-a499-b6dac0021134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:28.972978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c040a98-bf32-4b08-a499-b6dac0021134 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:28.974135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c040a98-bf32-4b08-a499-b6dac0021134 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:28.975835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c040a98-bf32-4b08-a499-b6dac0021134 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:28.977906 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 506/1005] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:28.983599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:28.992104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59e7fd-6456-42e6-9b36-493d5371882b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:28.996525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd035d4-5cb3-4b16-a23e-601dcfc9e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:28.997167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd035d4-5cb3-4b16-a23e-601dcfc9e9ba admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:28.997452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd035d4-5cb3-4b16-a23e-601dcfc9e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:28.997728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd035d4-5cb3-4b16-a23e-601dcfc9e9ba admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:28.998445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd035d4-5cb3-4b16-a23e-601dcfc9e9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:29.000357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd035d4-5cb3-4b16-a23e-601dcfc9e9ba admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:29.019055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 500/1006] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:45:28 2021] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:31.291184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b7c42-6d52-40f6-bb75-3855832b2f40 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.291741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b7c42-6d52-40f6-bb75-3855832b2f40 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.291857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b7c42-6d52-40f6-bb75-3855832b2f40 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.293548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 507/1007] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:31.299697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.300062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.300259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.317997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:31.319180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:31.327266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 501/1008] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:31.358281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b7c42-6d52-40f6-bb75-3855832b2f40 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:31.370454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b7c42-6d52-40f6-bb75-3855832b2f40 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:31.374652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:31.375470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.375787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.376062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] PATH_INFO: `/v3/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.377505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] RBAC: Authorizing `identity:get_role(role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:31.378502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:45:31.378502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:45:31.378502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:45:31.379368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:31.380686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 508/1009] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:31 2021] GET /identity/v3/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:31.387070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:31.395689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602001e-0b6e-48e2-b4d4-2c12b368a8d3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:31.400093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:31.400933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.401213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.401486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] PATH_INFO: `/v3/users/a2fbf324c88b47c6aef85d937f1c592a` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.414286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2fbf324c88b47c6aef85d937f1c592a)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:31.416432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:31.417996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 502/1010] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:31 2021] GET /identity/v3/users/a2fbf324c88b47c6aef85d937f1c592a => generated 286 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:31.424167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:31.433689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3593c3d-a064-42e9-a7e9-77a917adb357 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:31.438032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:31.438637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.438919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.439193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.447069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:31.448776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:31.457099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 509/1011] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:31.463202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:31.472332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff322-227a-4f05-a3a0-03a91ddbe654 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:31.477250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dea13c-d4ba-4dcd-a8da-36ce2a24354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:31.478055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea13c-d4ba-4dcd-a8da-36ce2a24354f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.478340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea13c-d4ba-4dcd-a8da-36ce2a24354f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.478619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dea13c-d4ba-4dcd-a8da-36ce2a24354f admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.479814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea13c-d4ba-4dcd-a8da-36ce2a24354f admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:31.481804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dea13c-d4ba-4dcd-a8da-36ce2a24354f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:31.483391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 503/1012] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:31 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:31.489452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:31.498371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81397bcb-f3ca-4938-b08a-ec2a784c3320 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:31.502725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:31.503333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:31.503635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:31.503920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:31.504751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] RBAC: Adding query filter params (role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=544e6da2df684d0e97130d11c4954cc8, user.id=a2fbf324c88b47c6aef85d937f1c592a) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:31.505065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:31.506827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78665c9f-af53-4ed9-8ff0-9690d907a67b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:31.511999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 510/1013] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:31 2021] GET /identity/v3/role_assignments?user.id=a2fbf324c88b47c6aef85d937f1c592a&scope.project.id=544e6da2df684d0e97130d11c4954cc8&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:33.682362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d6fc-df22-407b-a889-d6a865fd887b None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:33.682907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d6fc-df22-407b-a889-d6a865fd887b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:33.682907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d6fc-df22-407b-a889-d6a865fd887b None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:33.684703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 504/1014] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:33.690517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:33.690924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:33.691161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:33.708893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:33.710060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:33.718067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 511/1015] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:33.740926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d6fc-df22-407b-a889-d6a865fd887b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:33.752864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d6fc-df22-407b-a889-d6a865fd887b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:33.757075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:33.758387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:33.758689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:33.758961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] PATH_INFO: `/v3/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:33.760450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] RBAC: Authorizing `identity:get_role(role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:33.761442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:45:33.761442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:45:33.761442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:45:33.762328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:33.763601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 505/1016] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:33 2021] GET /identity/v3/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:33.769330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:33.778344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178297-fa6a-42bd-abc4-9fa794c305b2 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:33.782655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:33.783486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:33.783802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:33.784082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] PATH_INFO: `/v3/users/a2fbf324c88b47c6aef85d937f1c592a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:33.785266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] RBAC: Authorizing `identity:get_user(user_id=a2fbf324c88b47c6aef85d937f1c592a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:33.787349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:33.788955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 512/1017] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:33 2021] GET /identity/v3/users/a2fbf324c88b47c6aef85d937f1c592a => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:33.795107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:33.804152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ece463-8d40-4443-b3b8-7dc8b474f0b2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:33.808543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc6b8c-56dd-4f9f-aeda-be7e6aa2ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:33.809332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc6b8c-56dd-4f9f-aeda-be7e6aa2ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:33.809613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc6b8c-56dd-4f9f-aeda-be7e6aa2ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:33.809886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc6b8c-56dd-4f9f-aeda-be7e6aa2ef82 admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:33.811038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc6b8c-56dd-4f9f-aeda-be7e6aa2ef82 admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:33.813038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc6b8c-56dd-4f9f-aeda-be7e6aa2ef82 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:33.814612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 506/1018] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:33 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:33.820995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:33.829909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414ea1c-e1f4-4739-8271-8f6cc3b2373c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:33.834270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323c33-94f0-477d-a595-bbdfa7265eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:33.835095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323c33-94f0-477d-a595-bbdfa7265eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:33.835380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323c33-94f0-477d-a595-bbdfa7265eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:33.836254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323c33-94f0-477d-a595-bbdfa7265eb0 admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8/users/a2fbf324c88b47c6aef85d937f1c592a/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:33.838436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323c33-94f0-477d-a595-bbdfa7265eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=544e6da2df684d0e97130d11c4954cc8, user_id=a2fbf324c88b47c6aef85d937f1c592a, role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:33.841020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323c33-94f0-477d-a595-bbdfa7265eb0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:33.853250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 513/1019] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:45:33 2021] PUT /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8/users/a2fbf324c88b47c6aef85d937f1c592a/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:45:36.079371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef376-942f-4b97-b98e-a27e1e311d9a None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.079998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef376-942f-4b97-b98e-a27e1e311d9a None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.079998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ef376-942f-4b97-b98e-a27e1e311d9a None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.081713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 507/1020] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:36.087632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.088047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.088206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.105559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:36.106718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:36.159539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 514/1021] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:36.184049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef376-942f-4b97-b98e-a27e1e311d9a None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:36.196246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ef376-942f-4b97-b98e-a27e1e311d9a None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:36.200540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:36.201361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.201643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.201921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] PATH_INFO: `/v3/roles/4e5f98a69f814690b2ad5597e63f1efd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.203377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] RBAC: Authorizing `identity:get_role(role_id=4e5f98a69f814690b2ad5597e63f1efd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:36.205005 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:36.206290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 508/1022] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:36 2021] GET /identity/v3/roles/4e5f98a69f814690b2ad5597e63f1efd => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:36.212617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:36.220997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f43eb-3ad8-4b93-8cac-464f1aa32f94 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:36.225313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:36.226171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.226455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.226732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] PATH_INFO: `/v3/users/a2fbf324c88b47c6aef85d937f1c592a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.227949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] RBAC: Authorizing `identity:get_user(user_id=a2fbf324c88b47c6aef85d937f1c592a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:36.230026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:36.231562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 515/1023] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:36 2021] GET /identity/v3/users/a2fbf324c88b47c6aef85d937f1c592a => generated 286 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:36.237725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:36.247836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1a59d-43a1-4089-8c3d-32b125367129 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:36.252569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:36.253211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.253496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.253767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.262263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:36.264045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:36.272533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 509/1024] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:36 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:36.280266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:36.289615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f21e58-c709-4f67-b3b3-6505ef2a4e6e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:36.294317 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d2bb1-8a9a-4032-b0b2-950bd6ff12a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:36.295158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2bb1-8a9a-4032-b0b2-950bd6ff12a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.295444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2bb1-8a9a-4032-b0b2-950bd6ff12a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.295748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d2bb1-8a9a-4032-b0b2-950bd6ff12a4 admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.296930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2bb1-8a9a-4032-b0b2-950bd6ff12a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:36.298958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d2bb1-8a9a-4032-b0b2-950bd6ff12a4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:36.300619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 516/1025] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:36 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:36.307043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:36.315572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb0629-a5bf-467b-a874-987b8668cd9a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:36.320652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:36.321285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:36.321573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:36.321854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:36.322691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] RBAC: Adding query filter params (role.id=4e5f98a69f814690b2ad5597e63f1efd, scope.project.id=544e6da2df684d0e97130d11c4954cc8, user.id=a2fbf324c88b47c6aef85d937f1c592a) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:36.323005 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:36.324852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22e7e5-6e4b-4b14-b5d3-902c57df0dfd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:36.330405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 510/1026] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:36 2021] GET /identity/v3/role_assignments?user.id=a2fbf324c88b47c6aef85d937f1c592a&scope.project.id=544e6da2df684d0e97130d11c4954cc8&role.id=4e5f98a69f814690b2ad5597e63f1efd => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:38.549825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83c2d3-dde7-4bc3-8b53-b061e79aa281 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:38.550382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83c2d3-dde7-4bc3-8b53-b061e79aa281 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:38.550382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83c2d3-dde7-4bc3-8b53-b061e79aa281 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:38.552190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 517/1027] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:38.558712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:38.559132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:38.559266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:38.576503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:38.577671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:38.585129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 511/1028] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:38 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:38.610420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83c2d3-dde7-4bc3-8b53-b061e79aa281 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:38.622194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83c2d3-dde7-4bc3-8b53-b061e79aa281 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:38.626475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd0a3b-1d58-47b1-8fed-2f71fb3fd478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:38.627244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0a3b-1d58-47b1-8fed-2f71fb3fd478 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:38.627535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0a3b-1d58-47b1-8fed-2f71fb3fd478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:38.627847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd0a3b-1d58-47b1-8fed-2f71fb3fd478 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:38.629033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd0a3b-1d58-47b1-8fed-2f71fb3fd478 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:38.630721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd0a3b-1d58-47b1-8fed-2f71fb3fd478 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:38.632862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 518/1029] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:38.639378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:38.648652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cd6fcc-90a1-42e9-9957-71ee691eb464 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:38.653092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ad684-550d-4775-8d01-49a20eaf39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:38.653726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad684-550d-4775-8d01-49a20eaf39f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:38.654006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad684-550d-4775-8d01-49a20eaf39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:38.654281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ad684-550d-4775-8d01-49a20eaf39f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:38.655003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad684-550d-4775-8d01-49a20eaf39f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:38.656925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ad684-550d-4775-8d01-49a20eaf39f5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:38.681200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 512/1030] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:38 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:40.900983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a2d8-94cc-4f68-b199-84a6c86ff8b8 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:40.901514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a2d8-94cc-4f68-b199-84a6c86ff8b8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:40.901607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496a2d8-94cc-4f68-b199-84a6c86ff8b8 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:40.903295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 519/1031] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:40.909097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:40.909477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:40.909657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:40.926923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:40.928119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:40.982942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 513/1032] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:41.008180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496a2d8-94cc-4f68-b199-84a6c86ff8b8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:41.019923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496a2d8-94cc-4f68-b199-84a6c86ff8b8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:41.024683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e95a5-3df0-4742-b02b-e020e6131bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:41.025445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e95a5-3df0-4742-b02b-e020e6131bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:41.025732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e95a5-3df0-4742-b02b-e020e6131bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:41.026008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e95a5-3df0-4742-b02b-e020e6131bfa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:41.027177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e95a5-3df0-4742-b02b-e020e6131bfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:41.028880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e95a5-3df0-4742-b02b-e020e6131bfa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:41.030418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 520/1033] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:45:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:41.036096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:41.045405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e7101-7a97-4518-9c56-dc3b76137d92 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:41.049785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abdd71-77d4-43d2-b79c-2cf75cce185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:41.050420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abdd71-77d4-43d2-b79c-2cf75cce185f admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:41.050700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abdd71-77d4-43d2-b79c-2cf75cce185f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:41.050974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abdd71-77d4-43d2-b79c-2cf75cce185f admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:41.051724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abdd71-77d4-43d2-b79c-2cf75cce185f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:41.053593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abdd71-77d4-43d2-b79c-2cf75cce185f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:41.072572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 514/1034] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:45:41 2021] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:43.381210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13e131-cf20-4928-8cf0-6cc31862b55b None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.381734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13e131-cf20-4928-8cf0-6cc31862b55b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.381851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13e131-cf20-4928-8cf0-6cc31862b55b None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.384136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 521/1035] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:43.389945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.390347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.390496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.407972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:43.409124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:43.416509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 515/1036] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:43.441215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13e131-cf20-4928-8cf0-6cc31862b55b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:43.453588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13e131-cf20-4928-8cf0-6cc31862b55b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:43.457870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:43.458627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.458914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.459195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.468904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:43.475585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:45:43.477233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 522/1037] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:45:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:43.483428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:43.492664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233dc3c-be89-4f1f-ae46-288867b3bdf0 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:43.497045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:43.497677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.497957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.498228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.498969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:43.499269 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:43.500861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:43.508811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 516/1038] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:43.514715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:43.524665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaa60f-7cfe-421a-b896-404173777b58 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:43.529074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:43.529891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.530179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.530459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] PATH_INFO: `/v3/users/d680c8d9112f49979ed46f38772b70f5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.543487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] RBAC: Authorizing `identity:get_user(user_id=d680c8d9112f49979ed46f38772b70f5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:43.545928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:43.547485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 523/1039] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:43 2021] GET /identity/v3/users/d680c8d9112f49979ed46f38772b70f5 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:43.553561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:43.563389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc952388-051f-4aa3-869e-2bc186671513 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:43.568240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:43.568363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.568647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.568920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.577165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:43.578888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:43.588476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 517/1040] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:43.594801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:43.604141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34020b-74e4-4f04-9e0e-e20028599c84 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:43.608581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4939a6a-63a4-4e98-90a1-c71718c0446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:43.609412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4939a6a-63a4-4e98-90a1-c71718c0446a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.609698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4939a6a-63a4-4e98-90a1-c71718c0446a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.609975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4939a6a-63a4-4e98-90a1-c71718c0446a admin admin] PATH_INFO: `/v3/projects/a8e075c0e5c9471da973df015bf5d36e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.611134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4939a6a-63a4-4e98-90a1-c71718c0446a admin admin] RBAC: Authorizing `identity:get_project(project_id=a8e075c0e5c9471da973df015bf5d36e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:43.613245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4939a6a-63a4-4e98-90a1-c71718c0446a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:43.614863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 524/1041] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:43 2021] GET /identity/v3/projects/a8e075c0e5c9471da973df015bf5d36e => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:43.620935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:43.629515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c133616-0de9-4540-8658-4f7a22eb44e1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:43.634767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:43.635323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:43.635603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:43.635902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:43.636722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=a8e075c0e5c9471da973df015bf5d36e, user.id=d680c8d9112f49979ed46f38772b70f5) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:43.637029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:43.638804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846f50d-5ef3-40c8-aa47-d251e93635ec admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:43.643949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 518/1042] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:43 2021] GET /identity/v3/role_assignments?user.id=d680c8d9112f49979ed46f38772b70f5&scope.project.id=a8e075c0e5c9471da973df015bf5d36e&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:45.845382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792bdfa-b01f-4550-a35c-554157d4b038 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:45.845893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792bdfa-b01f-4550-a35c-554157d4b038 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:45.845893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792bdfa-b01f-4550-a35c-554157d4b038 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:45.847640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 525/1043] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:45:45.853826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:45.854224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:45.854382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:45.872267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:45.873435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:45.880931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 519/1044] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:45.908575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792bdfa-b01f-4550-a35c-554157d4b038 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:45.920533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792bdfa-b01f-4550-a35c-554157d4b038 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:45.924745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:45.925503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:45.925785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:45.926058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:45.935698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:45.942348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:45:45.943467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 526/1045] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:45:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:45.950465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:45.959148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40d0b5-9b91-4b20-ad82-427b1e9c4e80 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:45.964309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:45.964964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:45.965244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:45.965516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:45.966270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:45.966575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:45.968189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:45.976319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 520/1046] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:45.982469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:45.993411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326fed-0be1-461b-8c5c-fbed17084a49 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:45.999306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:46.000902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:46.001357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:46.001797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] PATH_INFO: `/v3/users/d680c8d9112f49979ed46f38772b70f5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:46.003646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] RBAC: Authorizing `identity:get_user(user_id=d680c8d9112f49979ed46f38772b70f5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:46.007771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:46.010004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 527/1047] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:45 2021] GET /identity/v3/users/d680c8d9112f49979ed46f38772b70f5 => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:46.015951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:46.025719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfecff6a-ab14-47f7-9b4c-27bc65ad7c3a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:46.030127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457212d0-ee0f-4689-a508-db45264375e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:46.030946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457212d0-ee0f-4689-a508-db45264375e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:46.031233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457212d0-ee0f-4689-a508-db45264375e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:46.031510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457212d0-ee0f-4689-a508-db45264375e0 admin admin] PATH_INFO: `/v3/projects/a8e075c0e5c9471da973df015bf5d36e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:46.032705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457212d0-ee0f-4689-a508-db45264375e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=a8e075c0e5c9471da973df015bf5d36e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:46.034711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457212d0-ee0f-4689-a508-db45264375e0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:46.036341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 521/1048] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:46 2021] GET /identity/v3/projects/a8e075c0e5c9471da973df015bf5d36e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:46.042501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:46.051968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1fff6-10f9-4afc-98e1-cca2c25dc4cd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:46.056429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b2ed8-dd3d-462c-9f13-d104792244ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:46.057270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2ed8-dd3d-462c-9f13-d104792244ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:46.057550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2ed8-dd3d-462c-9f13-d104792244ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:46.057825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b2ed8-dd3d-462c-9f13-d104792244ea admin admin] PATH_INFO: `/v3/projects/a8e075c0e5c9471da973df015bf5d36e/users/d680c8d9112f49979ed46f38772b70f5/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:46.059775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2ed8-dd3d-462c-9f13-d104792244ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e075c0e5c9471da973df015bf5d36e, user_id=d680c8d9112f49979ed46f38772b70f5, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:46.062331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b2ed8-dd3d-462c-9f13-d104792244ea admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:46.075525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 528/1049] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:45:46 2021] PUT /identity/v3/projects/a8e075c0e5c9471da973df015bf5d36e/users/d680c8d9112f49979ed46f38772b70f5/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:45:48.281731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a96c-ee2e-4ede-94aa-f3f55faf848d None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.282276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a96c-ee2e-4ede-94aa-f3f55faf848d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.282276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5051a96c-ee2e-4ede-94aa-f3f55faf848d None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.284076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 522/1050] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:48.290518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.290956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.291087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.309436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:48.310614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:48.365360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 529/1051] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:48.400629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a96c-ee2e-4ede-94aa-f3f55faf848d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:48.417608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5051a96c-ee2e-4ede-94aa-f3f55faf848d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:48.423606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:48.424722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.425112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.425491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.438579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:45:48.449271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:45:48.450953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 523/1052] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:45:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:48.457267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:48.466389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac0232-3426-4acf-be25-307b9d11a89a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:48.470829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:48.471477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.471803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.472088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.472852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:48.473160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:48.474741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:48.483520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 530/1053] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:45:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:48.489645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:48.499664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5956c-a043-4316-8e3c-42b623ce4d69 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:48.504145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:48.504977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.505263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.505542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] PATH_INFO: `/v3/users/d680c8d9112f49979ed46f38772b70f5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.506764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] RBAC: Authorizing `identity:get_user(user_id=d680c8d9112f49979ed46f38772b70f5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:48.508965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:48.510514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 524/1054] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:45:48 2021] GET /identity/v3/users/d680c8d9112f49979ed46f38772b70f5 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:48.516469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:48.526287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58c33-9255-4d33-a63f-bb424ea70a5d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:48.530775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:48.531410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.531784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.532022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.540290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:48.542022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:48.550880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 531/1055] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:48.557430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:48.566872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14020480-5203-451e-bca6-5b82f3224e3c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:48.571352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d48edc-3bd2-44ad-a605-58485312572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:48.572221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d48edc-3bd2-44ad-a605-58485312572d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.572503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d48edc-3bd2-44ad-a605-58485312572d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.572780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d48edc-3bd2-44ad-a605-58485312572d admin admin] PATH_INFO: `/v3/projects/a8e075c0e5c9471da973df015bf5d36e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.573954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d48edc-3bd2-44ad-a605-58485312572d admin admin] RBAC: Authorizing `identity:get_project(project_id=a8e075c0e5c9471da973df015bf5d36e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:48.576032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d48edc-3bd2-44ad-a605-58485312572d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:48.577652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 525/1056] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:45:48 2021] GET /identity/v3/projects/a8e075c0e5c9471da973df015bf5d36e => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:48.584026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:48.593147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec496ff-71a0-44cf-afc8-00fd62b2dcdd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:48.597992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:48.598627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:48.598916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:48.599195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:48.600067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=a8e075c0e5c9471da973df015bf5d36e, user.id=d680c8d9112f49979ed46f38772b70f5) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:48.600387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:48.602741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01439-70a6-4e5b-94ba-4d659bafdc17 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:48.608352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 532/1057] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:45:48 2021] GET /identity/v3/role_assignments?user.id=d680c8d9112f49979ed46f38772b70f5&scope.project.id=a8e075c0e5c9471da973df015bf5d36e&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:50.951228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1c410-4f72-4c5a-868e-2176c039a2e0 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:50.951797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1c410-4f72-4c5a-868e-2176c039a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:50.951797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1c410-4f72-4c5a-868e-2176c039a2e0 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:50.953598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 526/1058] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:50.959913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:50.960393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:50.960482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:50.979526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:50.981383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:50.989853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 533/1059] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:51.014137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1c410-4f72-4c5a-868e-2176c039a2e0 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:51.026049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1c410-4f72-4c5a-868e-2176c039a2e0 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:51.030338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:51.030966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:51.031250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:51.031525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:51.039454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:51.041217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:51.049942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 527/1060] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:45:51 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:45:51.056825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:51.065416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a4fac-fe84-46ee-9dfc-6b1bb8b26038 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:51.069840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:51.070617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:51.070899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:51.071177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:51.077779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:51.079570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:51.092618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c9701cf9-c476-4729-aa03-905e8b5669ff admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 09 04:45:51.093716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 534/1061] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:45:51 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:45:51.100230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:51.109274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16755d-e33c-4e81-b5ec-c9affd1276d8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:51.113758 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:51.114390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:51.114677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:51.114951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:51.115739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:45:51.116046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:51.118158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6400a-c383-4b3d-823b-e4ad27e7d564 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:51.125343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 528/1062] 10.222.0.41 () {56 vars in 1136 bytes} [Tue Nov 9 04:45:51 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:53.364818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49d06b-4048-432c-9765-c28fd845bfb7 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:53.365347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49d06b-4048-432c-9765-c28fd845bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:53.365437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49d06b-4048-432c-9765-c28fd845bfb7 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:53.367728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 535/1063] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:53.373595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3f8a-37ca-4ad4-9d0d-7170d65fb872 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:53.373980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3f8a-37ca-4ad4-9d0d-7170d65fb872 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:53.374157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f3f8a-37ca-4ad4-9d0d-7170d65fb872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:53.391298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2d0f3f8a-37ca-4ad4-9d0d-7170d65fb872 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:53.392499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2d0f3f8a-37ca-4ad4-9d0d-7170d65fb872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:53.399982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 529/1064] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:53.423716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49d06b-4048-432c-9765-c28fd845bfb7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:53.435987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49d06b-4048-432c-9765-c28fd845bfb7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:53.440221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:53.440850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:53.441136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:53.441415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:53.442171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:53.443166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:45:53.443166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:45:53.443166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:45:53.444105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4a044-9181-48df-bf1e-d79a362db435 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:53.458218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 536/1065] 10.222.0.41 () {60 vars in 1159 bytes} [Tue Nov 9 04:45:53 2021] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:55.703719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9884-cc46-4c00-a1a5-0087303a7d22 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:55.704265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9884-cc46-4c00-a1a5-0087303a7d22 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:55.704265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed9884-cc46-4c00-a1a5-0087303a7d22 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:55.706025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 530/1066] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:55.712655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:55.713034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:55.713231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:55.730545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:55.731764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:55.786975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 537/1067] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:45:55.811423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed9884-cc46-4c00-a1a5-0087303a7d22 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:55.823874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed9884-cc46-4c00-a1a5-0087303a7d22 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:55.828111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2e931-e225-485d-9840-7ac6bf89e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:55.828938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2e931-e225-485d-9840-7ac6bf89e78e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:55.829220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2e931-e225-485d-9840-7ac6bf89e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:55.829495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2e931-e225-485d-9840-7ac6bf89e78e admin admin] PATH_INFO: `/v3/domains/dca50b3597004bdf9beab08e2aaf76ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:55.840288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2e931-e225-485d-9840-7ac6bf89e78e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=dca50b3597004bdf9beab08e2aaf76ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:55.842227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2e931-e225-485d-9840-7ac6bf89e78e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:55.843813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 531/1068] 10.222.0.41 () {56 vars in 1204 bytes} [Tue Nov 9 04:45:55 2021] GET /identity/v3/domains/dca50b3597004bdf9beab08e2aaf76ea => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:45:55.849948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:55.859028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c433c3b-9097-4b90-a896-9936b010898f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:55.863456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6896be-85ca-4e20-bb55-de018e074ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:55.864135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6896be-85ca-4e20-bb55-de018e074ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:55.864424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6896be-85ca-4e20-bb55-de018e074ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:55.864705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6896be-85ca-4e20-bb55-de018e074ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:55.865432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6896be-85ca-4e20-bb55-de018e074ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:55.867894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6896be-85ca-4e20-bb55-de018e074ab9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:55.892897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 538/1069] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:45:55 2021] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:45:58.142877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9aa6-c122-4277-816f-2f26a00e50df None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:58.143402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9aa6-c122-4277-816f-2f26a00e50df None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:58.143402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed9aa6-c122-4277-816f-2f26a00e50df None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:58.145220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 532/1070] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:45:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:45:58.151193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:58.151653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:58.151790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:58.169169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:45:58.170364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:45:58.224956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 539/1071] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:45:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:45:58.250514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9aa6-c122-4277-816f-2f26a00e50df None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:58.262765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed9aa6-c122-4277-816f-2f26a00e50df None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:58.266969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c772f1-e247-4fe4-8ab8-e7357476822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:58.267885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c772f1-e247-4fe4-8ab8-e7357476822b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:58.268167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c772f1-e247-4fe4-8ab8-e7357476822b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:58.268433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c772f1-e247-4fe4-8ab8-e7357476822b admin admin] PATH_INFO: `/v3/domains/dca50b3597004bdf9beab08e2aaf76ea` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:58.269602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c772f1-e247-4fe4-8ab8-e7357476822b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=dca50b3597004bdf9beab08e2aaf76ea)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:58.271518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c772f1-e247-4fe4-8ab8-e7357476822b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:58.273079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 533/1072] 10.222.0.41 () {56 vars in 1204 bytes} [Tue Nov 9 04:45:58 2021] GET /identity/v3/domains/dca50b3597004bdf9beab08e2aaf76ea => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:45:58.279018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:45:58.287565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e30dfa-63b7-4902-85ce-295d0d21ef87 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:45:58.292027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac2dc-a507-4edf-a2ae-7ae61064d30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:45:58.292677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac2dc-a507-4edf-a2ae-7ae61064d30b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:45:58.292994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac2dc-a507-4edf-a2ae-7ae61064d30b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:45:58.293277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac2dc-a507-4edf-a2ae-7ae61064d30b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:45:58.294271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac2dc-a507-4edf-a2ae-7ae61064d30b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:45:58.296216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac2dc-a507-4edf-a2ae-7ae61064d30b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:45:58.314707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 540/1073] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:45:58 2021] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:46:00.570030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edda44-976d-46d4-8eca-b928cb874816 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.570030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edda44-976d-46d4-8eca-b928cb874816 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.570030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edda44-976d-46d4-8eca-b928cb874816 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.571416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 534/1074] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:46:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:46:00.577398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.577811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.577957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.594853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:46:00.596074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:46:00.603540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 541/1075] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:46:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:46:00.627969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edda44-976d-46d4-8eca-b928cb874816 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:00.640160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23edda44-976d-46d4-8eca-b928cb874816 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:00.644412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:00.645170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.645450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.645719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.655963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:46:00.663171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:46:00.664643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 535/1076] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:46:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:46:00.672474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:00.681764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4e1bf-5ae8-4060-8a56-f95e6be50cab None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:00.686212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:00.686855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.687138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.687414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.688211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:46:00.688517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:00.690085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:00.698489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 542/1077] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:46:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:00.704589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:00.713927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d55d1-08af-4c20-94b8-a4b48ece1b03 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:00.718323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:00.719156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.719440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.719769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] PATH_INFO: `/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.733156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8b3ccbc13cb4dce9e8e37244f82d0f3)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:00.735282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:00.736882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 536/1078] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:46:00 2021] GET /identity/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:00.743816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:00.752930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a5ec7f-b667-4a96-b14c-48f31aeb3b0f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:00.757288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:00.757900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.758180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.758456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.765762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:00.767455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:00.775791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 543/1079] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:46:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:46:00.781817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:00.791329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2c8f2-8be2-4b8e-b037-c4d213e55a60 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:00.796012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6334949-6808-46c0-895d-49bca0b0c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:00.796839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334949-6808-46c0-895d-49bca0b0c4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.797124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334949-6808-46c0-895d-49bca0b0c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.797400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6334949-6808-46c0-895d-49bca0b0c4f2 admin admin] PATH_INFO: `/v3/projects/37b6065a0d2b4f05acf45b9adc524134` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.798556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334949-6808-46c0-895d-49bca0b0c4f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=37b6065a0d2b4f05acf45b9adc524134)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:00.800595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6334949-6808-46c0-895d-49bca0b0c4f2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:00.802172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 537/1080] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:46:00 2021] GET /identity/v3/projects/37b6065a0d2b4f05acf45b9adc524134 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:00.808863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:00.817001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11a8f4-d72c-4703-a874-7752f77fc48a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:00.821387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:00.821935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:00.822215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:00.822488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:00.823303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=37b6065a0d2b4f05acf45b9adc524134, user.id=d8b3ccbc13cb4dce9e8e37244f82d0f3) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:46:00.823610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:00.825383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacf765-6a03-4dcf-b33e-ca141adbc5e5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:00.830547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 544/1081] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:46:00 2021] GET /identity/v3/role_assignments?user.id=d8b3ccbc13cb4dce9e8e37244f82d0f3&scope.project.id=37b6065a0d2b4f05acf45b9adc524134&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:46:03.025471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd1be-a2de-4527-b2fa-98bcaff3123e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.026029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd1be-a2de-4527-b2fa-98bcaff3123e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.026029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cd1be-a2de-4527-b2fa-98bcaff3123e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.027809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 538/1082] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:46:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:46:03.033660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639c48-347b-4978-a541-407923f76072 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.034039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639c48-347b-4978-a541-407923f76072 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.034236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20639c48-347b-4978-a541-407923f76072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.055231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-20639c48-347b-4978-a541-407923f76072 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:46:03.056449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-20639c48-347b-4978-a541-407923f76072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:46:03.064034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 545/1083] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:46:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:46:03.087448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd1be-a2de-4527-b2fa-98bcaff3123e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:03.099270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cd1be-a2de-4527-b2fa-98bcaff3123e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:03.104087 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:03.104850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.105133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.105408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.115246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:46:03.122558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:46:03.123680 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 539/1084] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:46:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:46:03.130041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20639c48-347b-4978-a541-407923f76072 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:03.138650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20639c48-347b-4978-a541-407923f76072 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:03.143073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:03.143756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.144048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.144330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.145095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:46:03.145405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:03.146989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:03.154949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 546/1085] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:46:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:03.160788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:03.171157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a82d9-e0ea-4cc4-9be2-fb42bf201b0a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:03.175539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:03.176378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.176659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.176938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] PATH_INFO: `/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.178126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] RBAC: Authorizing `identity:get_user(user_id=d8b3ccbc13cb4dce9e8e37244f82d0f3)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:03.180801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:03.182322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 540/1086] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:46:03 2021] GET /identity/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:46:03.188040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:03.197161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e23ad-82b5-483c-83c9-15b0d1206b82 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:03.201578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412d64a-44df-4926-b050-e5e4b9d91df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:03.202398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412d64a-44df-4926-b050-e5e4b9d91df6 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.202688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412d64a-44df-4926-b050-e5e4b9d91df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.202969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412d64a-44df-4926-b050-e5e4b9d91df6 admin admin] PATH_INFO: `/v3/projects/37b6065a0d2b4f05acf45b9adc524134` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.204180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412d64a-44df-4926-b050-e5e4b9d91df6 admin admin] RBAC: Authorizing `identity:get_project(project_id=37b6065a0d2b4f05acf45b9adc524134)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:03.206191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412d64a-44df-4926-b050-e5e4b9d91df6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:03.207867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 547/1087] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:46:03 2021] GET /identity/v3/projects/37b6065a0d2b4f05acf45b9adc524134 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:03.213914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:03.223024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c18823-091b-4a7c-bfa2-2cf10c239e3d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:03.227939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11f6db-2755-4501-a589-84a6b4b2a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:03.228771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f6db-2755-4501-a589-84a6b4b2a5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:03.229051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f6db-2755-4501-a589-84a6b4b2a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:03.229321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11f6db-2755-4501-a589-84a6b4b2a5b8 admin admin] PATH_INFO: `/v3/projects/37b6065a0d2b4f05acf45b9adc524134/users/d8b3ccbc13cb4dce9e8e37244f82d0f3/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:03.231223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11f6db-2755-4501-a589-84a6b4b2a5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b6065a0d2b4f05acf45b9adc524134, user_id=d8b3ccbc13cb4dce9e8e37244f82d0f3, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:03.233825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11f6db-2755-4501-a589-84a6b4b2a5b8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:03.246582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 541/1088] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:46:03 2021] PUT /identity/v3/projects/37b6065a0d2b4f05acf45b9adc524134/users/d8b3ccbc13cb4dce9e8e37244f82d0f3/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:46:05.438928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20171cff-a2e2-4460-93b6-19855bd00817 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.439553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20171cff-a2e2-4460-93b6-19855bd00817 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.439553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20171cff-a2e2-4460-93b6-19855bd00817 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.441305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 548/1089] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:46:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:46:05.447583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.448048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.448147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.465626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:46:05.466787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:46:05.519380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 542/1090] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:46:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:46:05.544561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20171cff-a2e2-4460-93b6-19855bd00817 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:05.556800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20171cff-a2e2-4460-93b6-19855bd00817 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:05.561147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:05.561916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.562206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.562487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.572981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:46:05.579805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:46:05.580961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 549/1091] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:46:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:46:05.588145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:05.596737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0dd6b-0610-4848-9ded-4f34837d3b1c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:05.601229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:05.601870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.602152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.602428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.603179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:46:05.603482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:05.605132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:05.613029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 543/1092] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:46:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:05.619788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:05.629555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e470e-1d4b-4ddd-a252-48450e5c1e1d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:05.634589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:05.635415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.635733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.636021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] PATH_INFO: `/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.637217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] RBAC: Authorizing `identity:get_user(user_id=d8b3ccbc13cb4dce9e8e37244f82d0f3)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:05.639307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:05.640954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 550/1093] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:46:05 2021] GET /identity/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:46:05.646688 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:05.655801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cc322-745d-4585-be8b-7de46d8cfab3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:05.660144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:05.660749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.661029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.661300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.668975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:05.670666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:05.679536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 544/1094] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:46:05 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:46:05.685769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:05.695938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7e95d-af4e-4f2b-92ac-8e7f6c73e7ec admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:05.700701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b2c7-18e9-483b-9f6a-195ab0f01717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:05.701617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b2c7-18e9-483b-9f6a-195ab0f01717 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.701933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b2c7-18e9-483b-9f6a-195ab0f01717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.702251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b2c7-18e9-483b-9f6a-195ab0f01717 admin admin] PATH_INFO: `/v3/projects/37b6065a0d2b4f05acf45b9adc524134` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.703478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b2c7-18e9-483b-9f6a-195ab0f01717 admin admin] RBAC: Authorizing `identity:get_project(project_id=37b6065a0d2b4f05acf45b9adc524134)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:05.705674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b2c7-18e9-483b-9f6a-195ab0f01717 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:05.707831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 551/1095] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:46:05 2021] GET /identity/v3/projects/37b6065a0d2b4f05acf45b9adc524134 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:46:05.715009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:46:05.723789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae5410-d77e-48c8-b689-a891085f2cc4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:46:05.728266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:46:05.728896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:46:05.729175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:46:05.729448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:46:05.730277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=37b6065a0d2b4f05acf45b9adc524134, user.id=d8b3ccbc13cb4dce9e8e37244f82d0f3) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:46:05.730585 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:46:05.732447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d4ab3-2135-4ac7-a775-d66204c60437 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:46:05.737946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 545/1096] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:46:05 2021] GET /identity/v3/role_assignments?user.id=d8b3ccbc13cb4dce9e8e37244f82d0f3&scope.project.id=37b6065a0d2b4f05acf45b9adc524134&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:00.871886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174ba1-4a28-404a-b25b-24974b536f57 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:00.872603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174ba1-4a28-404a-b25b-24974b536f57 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:00.872603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a174ba1-4a28-404a-b25b-24974b536f57 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:00.874134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 552/1097] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:00.881237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:00.881842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:00.881842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:00.900163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:00.901363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:00.913785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 546/1098] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:00 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:00.943913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a174ba1-4a28-404a-b25b-24974b536f57 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:00.960282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a174ba1-4a28-404a-b25b-24974b536f57 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:00.966504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:00.967299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:00.967586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:00.967901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:00.982109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:00.982109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:01.000098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:01.001334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 553/1099] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:01.008192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:01.017978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40057b91-b0d0-49cc-9c95-4555be1dfa6b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:01.026008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:01.026885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:01.027216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:01.027671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:01.028532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:01.028998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:01.030909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff122a65-92aa-4da1-8b30-40536190ee94 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:01.048038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 547/1100] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:01.052179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:01.062768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4761cd-a324-4c5e-bc46-613626c37a3d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:01.068101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1321527-690a-4253-90b0-f99a7f5a71e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:01.068934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1321527-690a-4253-90b0-f99a7f5a71e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:01.069321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1321527-690a-4253-90b0-f99a7f5a71e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:01.069694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1321527-690a-4253-90b0-f99a7f5a71e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:01.070685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1321527-690a-4253-90b0-f99a7f5a71e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:01.072816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1321527-690a-4253-90b0-f99a7f5a71e2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:01.103920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 554/1101] 10.222.0.41 () {60 vars in 1153 bytes} [Tue Nov 9 04:47:01 2021] POST /identity/v3/users => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:47:03.646045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c13fa-f847-4b22-9164-70263a7f6fe8 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.646045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c13fa-f847-4b22-9164-70263a7f6fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.646045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c13fa-f847-4b22-9164-70263a7f6fe8 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.646045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 548/1102] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:03.652749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.653213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.655385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.675368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:03.677134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:03.685120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 555/1103] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:03.712610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c13fa-f847-4b22-9164-70263a7f6fe8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:03.726842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c13fa-f847-4b22-9164-70263a7f6fe8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:03.731938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:03.732848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.733134 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.733432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.746671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:47:03.755027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:47:03.756396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 549/1104] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:47:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:03.763947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:03.775251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d67f1-1058-4534-9d9e-16c563ae229e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:03.780247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:03.781344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.781448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.781723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.782609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:03.782985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:03.784773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:03.794834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 556/1105] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:47:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:03.802388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:03.812595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29bf16-703e-4b5e-bf3d-da3a5aa7708f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:03.818267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:03.819377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.819637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.819969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.832528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:03.834751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:03.853747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:03.855055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 550/1106] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:03.862206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:03.873006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eaa6af-a33b-486c-be6d-fe14821f6f21 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:03.878872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:03.879579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.879920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.880231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.880985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:03.881341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:03.883078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:03.896698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 557/1107] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:03.903495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:03.914396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962162c3-53ae-4e40-83ca-023d1c7ae552 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:03.919664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:03.920534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.920823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.921124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.929931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:03.932495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:03.947966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 09 04:47:03.949325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 551/1108] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:03.956663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:03.967311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8835b3-c8bb-4dcb-828a-a2c7521e1560 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:03.973103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:03.973975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:03.974260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:03.974615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:03.975521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:03.975929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:03.977957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:03.997940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 558/1109] 10.222.0.41 () {56 vars in 1164 bytes} [Tue Nov 9 04:47:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:04.005204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:04.015020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf976f6-150f-4494-9615-49a67b08c877 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:04.020073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:04.020563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:04.020849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:04.021127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:04.029221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:04.031164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:04.041550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 552/1110] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:47:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:47:04.048992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:04.062716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a607b-6303-43ff-9f0b-3ea167029185 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:04.070477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:04.071325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:04.071808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:04.072245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:04.084707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:04.086772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:04.106301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:04.112245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 559/1111] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:04.115177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:04.124361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e99678-989c-4885-9222-54fd4977de63 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:04.129961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:04.130774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:04.131127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:04.131524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:04.132408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:04.132796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:04.134497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:04.148339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 553/1112] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:04.154448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:04.166100 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a6225-e6e6-4f3f-9ba5-5880d2007d90 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:04.171962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:04.172942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:04.173338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:04.173759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:04.182148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:04.184211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:04.197933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:47:04.199376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 560/1113] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:47:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:04.206410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:04.218088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc98a9-b5ff-43bf-a319-549ce71c248d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:04.224346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:04.225254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:04.225535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:04.225992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:04.226872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:04.227222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:04.229488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c38088-23f8-4973-a972-2c72b4d1bf4b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:04.251667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 554/1114] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:47:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:04.254093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:04.267902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d925a4-436d-4128-8c49-b86bcd209804 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:04.274691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:04.274691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:04.274691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:04.274691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:04.275467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=e2a6d780d4ee491b933e0eac87c13593) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:04.275886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:04.278005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e28f5-22df-44c7-a65d-69cbdd19ab4e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:04.284611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 561/1115] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:47:04 2021] GET /identity/v3/role_assignments?user.id=e2a6d780d4ee491b933e0eac87c13593&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:06.600127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec6b7-bb73-4b42-9600-aa9c7e4e0404 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.600708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec6b7-bb73-4b42-9600-aa9c7e4e0404 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.601147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec6b7-bb73-4b42-9600-aa9c7e4e0404 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.603058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 555/1116] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:06.611795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.612354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.612354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.635003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:06.636807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:06.651665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 562/1117] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:06.674050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec6b7-bb73-4b42-9600-aa9c7e4e0404 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.686968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec6b7-bb73-4b42-9600-aa9c7e4e0404 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.692058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.692714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.692994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.693369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.704292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:47:06.711761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:47:06.713018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 556/1118] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:06.719806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.728798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3106-944b-4f06-a28b-fe8f735f0a6e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.733369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.734019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.734337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.734577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.735343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] RBAC: Adding query filter params (name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:06.735713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:06.737318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:06.751581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 563/1119] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:06.752607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.763723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbee0d9-105f-4991-a4ca-974c4c1108be admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.770491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.771418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.771734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.772085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.784395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:06.786473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:06.804853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:06.806209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 557/1120] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:06.812765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.824100 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc34041-1198-487d-8414-181ba51943fd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.829705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.830445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.830732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.831017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.831843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:06.832668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:06.834361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:06.848896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 564/1121] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:06.854842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.864607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5a03a-2950-42b1-9771-b87a284d8dcb admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.869788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.870558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.870873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.871137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.880095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:06.882125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:06.896579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 09 04:47:06.897763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 558/1122] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:06.904406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.916720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd689b4-d9af-43f6-adf1-134153d5bb77 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.921660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.922375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.922709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.922995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.923912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:06.924229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:06.926124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:06.951668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 565/1123] 10.222.0.41 () {56 vars in 1164 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:06.952187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:06.967671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6885f-2df7-4547-955d-b3f3c4a2f7e8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:06.970279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:06.971387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:06.971937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:06.972305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:06.988339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:06.992196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:07.014496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:07.016992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 559/1124] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:07.023572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:07.035083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68486-9678-4040-a2c7-7f95f9938af3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:07.040806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:07.041617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:07.042261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:07.042954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:07.043553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:07.043930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:07.045685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:07.059371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 566/1125] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:07.067317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:07.080608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58154c1-c924-4a94-b183-211e8e4160fa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:07.089160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:07.090110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:07.090433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:07.091520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:07.098817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:07.100813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:07.117054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:47:07.118400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 560/1126] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:47:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:07.125331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:07.137004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09414f53-d51d-4279-a71a-b7ef39c21491 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:07.142038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:07.142811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:07.143165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:07.143521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:07.144499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:07.144823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:07.146878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c418fe2-4ad8-4fd4-bba9-60c0475447a4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:07.160171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 567/1127] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:47:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:07.167931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:07.177901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47021404-cb62-4acd-8bb5-76fa4c512437 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:07.183524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a66d26-1995-4021-9911-c1530a698987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:07.184568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66d26-1995-4021-9911-c1530a698987 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:07.184902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66d26-1995-4021-9911-c1530a698987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:07.185172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a66d26-1995-4021-9911-c1530a698987 admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/e2a6d780d4ee491b933e0eac87c13593/roles/22336b6631964f3a89bb1da49f7ac486` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:07.203203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a66d26-1995-4021-9911-c1530a698987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=e2a6d780d4ee491b933e0eac87c13593, role_id=22336b6631964f3a89bb1da49f7ac486)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:07.206663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a66d26-1995-4021-9911-c1530a698987 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:07.219466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 561/1128] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:47:07 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/e2a6d780d4ee491b933e0eac87c13593/roles/22336b6631964f3a89bb1da49f7ac486 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:47:09.615471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9bb59-4708-413b-925e-b8d4d5a4a494 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.616064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9bb59-4708-413b-925e-b8d4d5a4a494 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.616064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9bb59-4708-413b-925e-b8d4d5a4a494 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.617835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 568/1129] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:09.624972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.625451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.625568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.646235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:09.647576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:09.704887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 562/1130] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:09.732496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9bb59-4708-413b-925e-b8d4d5a4a494 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:09.746626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9bb59-4708-413b-925e-b8d4d5a4a494 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:09.751869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:09.752747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.753012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.753323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.764956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:47:09.773390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 09 04:47:09.774817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 569/1131] 10.222.0.41 () {56 vars in 1123 bytes} [Tue Nov 9 04:47:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:09.781716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:09.791395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7c421-c6ff-4f9d-b695-5d23bed23b2d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:09.797013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:09.797815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.798104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.798378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.799458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:09.799788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:09.801867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:09.815662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 563/1132] 10.222.0.41 () {56 vars in 1124 bytes} [Tue Nov 9 04:47:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:09.818930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:09.829856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf4a39-3574-4d21-b4f7-f7ddab305312 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:09.835036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:09.835838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.836120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.836394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.848314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:09.850462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:09.867986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:09.869178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 570/1133] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:09.875986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:09.886839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9622a0b-6b06-4eab-b1a9-4e700f5227fc admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:09.891922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:09.892778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.893175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.893476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.894283 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:09.895261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:09.896905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:09.911473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 564/1134] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:09.918249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:09.928935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32129-49e7-49bd-a5e4-09812142b4ea admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:09.933955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:09.934975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.935264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.935539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.944725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:09.947136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:09.962905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 09 04:47:09.964316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 571/1135] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:09 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:09.971712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:09.983528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef9ec0-d2c1-488e-b532-da368bdbc8d6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:09.989486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:09.990298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:09.990666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:09.991060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:09.992108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:09.992888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:09.994486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.013842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 565/1136] 10.222.0.41 () {56 vars in 1164 bytes} [Tue Nov 9 04:47:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:10.020819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:10.030534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9bc5f-b5a2-4c67-914d-47c31f5bb18f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:10.036607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:10.037345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:10.037705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:10.038022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:10.047369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:10.049301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.060120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 572/1137] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:47:10 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:47:10.067210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:10.076922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72e60-a3e0-430d-8bb9-7f190b124e48 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:10.081449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:10.082755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:10.083039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:10.083323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:10.093500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:10.095298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.117344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:10.118657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 566/1138] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:10.125104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:10.133947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad52b2-9e5b-4073-94fa-67e3900aaec9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:10.138502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:10.139163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:10.139468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:10.139819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:10.140689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:10.141032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:10.142790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.154772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 573/1139] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:10.161655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:10.172190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317cf8a-e10a-4124-925b-25c4325cbc26 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:10.177428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:10.178406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:10.178692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:10.178978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:10.187014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:10.189260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.203152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:47:10.204378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 567/1140] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:47:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:10.211613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:10.223503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb6cd4-b6b4-4a45-b0d1-9e4bc0dc29c7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:10.228407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:10.229171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:10.229431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:10.229841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:10.230658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:10.230987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:10.233132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a887c42-2d74-4995-a9d1-20cda6fb6ecd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.246371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 574/1141] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:47:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:10.254721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:10.266763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20233d-e96f-4f2b-ab3f-9128b4bdb6ec admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:10.273031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:10.274026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:10.274370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:10.274752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:10.275766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] RBAC: Adding query filter params (role.id=22336b6631964f3a89bb1da49f7ac486, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=e2a6d780d4ee491b933e0eac87c13593) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:10.276181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:10.278454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e1307-3a0f-4111-8f64-5064d6716cf3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:10.285914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 568/1142] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:47:10 2021] GET /identity/v3/role_assignments?user.id=e2a6d780d4ee491b933e0eac87c13593&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=22336b6631964f3a89bb1da49f7ac486 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:12.690594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f0ceb-ae13-49e8-9e5b-d3bcb728def5 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.691754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f0ceb-ae13-49e8-9e5b-d3bcb728def5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.691754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f0ceb-ae13-49e8-9e5b-d3bcb728def5 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.693493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 575/1143] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:47:12.700497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.701198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.701317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.721696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:12.723701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:12.732864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 569/1144] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:12.757776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f0ceb-ae13-49e8-9e5b-d3bcb728def5 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:12.769985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f0ceb-ae13-49e8-9e5b-d3bcb728def5 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:12.774843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:12.775737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.776022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.776298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.789501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:47:12.797011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:47:12.798220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 576/1145] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:47:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:12.805972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:12.814988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d01368-4b95-4917-a49c-3e4871ae4e31 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:12.819975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:12.820673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.821027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.821312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.822775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:12.823091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:12.824746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:12.833398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 570/1146] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:47:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:12.839801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:12.852287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0f240-c91b-43b8-a860-fd0713930518 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:12.857581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:12.858540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.858909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.859298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.870489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:12.872374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:12.889744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:12.890923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 577/1147] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:12.897946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:12.907653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f47f27-f752-4ab2-abb4-618e551bd438 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:12.912319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:12.912956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.913239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.913521 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.914267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:12.914603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:12.916238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:12.929166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 571/1148] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:12.935438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:12.947132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eb597-82ec-4820-a882-bc56f0238902 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:12.954197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:12.955087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:12.955438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:12.955782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:12.964050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:12.966076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:12.980329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 09 04:47:12.981504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 578/1149] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:12 2021] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:12.988063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.002109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b671d4-1928-4070-aa2a-0e04abb4f3a0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.007848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.008524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.008851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.009082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.010106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:13.010420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.012575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.039441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 572/1150] 10.222.0.41 () {56 vars in 1164 bytes} [Tue Nov 9 04:47:12 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:13.040666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.050849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf4257-c076-4fed-b95d-1335ff5b8bbb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.055642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.056334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.056622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.056905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.064992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.067274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.076340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 579/1151] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:47:13 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:47:13.083390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.093177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267487-e0fc-4bd7-af91-8d7bdb9d5466 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.098419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.099463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.099832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.100095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.110570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.112490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.130191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:13.131341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 573/1152] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:13.137766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.146863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508ae8b-ca77-4b7a-bd5c-65e264de44f0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.151991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.152675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.152972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.153248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.154041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:13.154355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.155973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.167369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 580/1153] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:13.173471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.183731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee96c6-0a96-4907-8d5c-5508b348a71a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.188323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.189112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.189423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.189679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.197260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.199258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.213111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:47:13.214737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 574/1154] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:47:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:13.221201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.231982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aebf46-b769-4a8a-821c-442a8b230e7c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.237571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.238827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.239115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.239441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.240331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:13.240679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.242609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4a2d8-d5e4-43cb-8cfe-e2a28a8b390d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.255772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 581/1155] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:47:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:13.262849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:13.274035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff84c-3038-443e-b571-aecc2b353cea admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:13.278670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:13.279326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:13.279609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:13.279961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:13.280860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=e2a6d780d4ee491b933e0eac87c13593) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:13.281178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:13.283190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81cb69-cac6-44dc-ac6d-98da1b717d6d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:13.289025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 575/1156] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:47:13 2021] GET /identity/v3/role_assignments?user.id=e2a6d780d4ee491b933e0eac87c13593&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=94424be31c964c5686644e854119e1dc => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:15.656193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e8b6-94c5-4b10-8d28-08935548df2f None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.656734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e8b6-94c5-4b10-8d28-08935548df2f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.656734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909e8b6-94c5-4b10-8d28-08935548df2f None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.660019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 582/1157] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:15.667926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.668446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.668564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.688547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:15.689960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:15.699811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 576/1158] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:15 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:15.728625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909e8b6-94c5-4b10-8d28-08935548df2f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:15.742360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909e8b6-94c5-4b10-8d28-08935548df2f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:15.747870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:15.748666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.748931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.749203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.760964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:47:15.767776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:47:15.769743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 583/1159] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:47:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:15.778674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:15.789968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d6243-5a8a-477e-87a2-b40cd3faee22 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:15.795478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:15.796161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.796441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.796712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.797590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:15.797931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:15.799955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:15.815795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 577/1160] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:47:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:15.817084 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:15.827523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37ebb-d4ae-4beb-a335-5c08037da3bd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:15.832242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:15.833011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.833290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.833584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.843698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:15.845539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:15.863535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:15.871750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 584/1161] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:15.872896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:15.882962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24d091-e8bc-4222-a09d-f7a50b4e2e9d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:15.888195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:15.889060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.889317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.889601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.890403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:15.890722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:15.892554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:15.905754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 578/1162] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:15.913255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:15.924237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f511c3-3a73-4c37-ae13-e725553b0faa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:15.929440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:15.930225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.930525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.930788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.938061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:15.940115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:15.954105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 09 04:47:15.955252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 585/1163] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:15 2021] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:15.962543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:15.972849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477631e2-1c85-4c59-8118-7c967015f986 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:15.978001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:15.978660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:15.978943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:15.979216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:15.980101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:15.980412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:15.982247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:16.002893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 579/1164] 10.222.0.41 () {56 vars in 1164 bytes} [Tue Nov 9 04:47:15 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:16.009887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:16.019886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01975646-7420-4297-8202-7ea24b18574e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:16.024500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:16.025291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:16.025558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:16.025867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:16.038087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:16.039984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:16.059233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:16.060568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 586/1165] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:16.069491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:16.079224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee56eb-28d5-448e-9c3b-73d719ba2905 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:16.084691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:16.085346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:16.085631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:16.085910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:16.086647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:16.086957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:16.088624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:16.103198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 580/1166] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:16.110736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:16.123448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7361d-802d-4f5b-8bff-6459bdfe9cfb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:16.129986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:16.130781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:16.131065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:16.131344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:16.139192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:16.141554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:16.156534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:47:16.157733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 587/1167] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:47:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:16.165394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:16.176545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd1d73-39ab-4e31-9c40-9a4a9a3555c6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:16.181160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:16.181818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:16.182207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:16.182566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:16.183600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:16.184059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:16.186500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7b665-dd72-47e9-beda-e323ab25d92a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:16.204193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 581/1168] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:47:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:16.213539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:16.224171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a231a-a0f8-417c-b0a8-afa6b8389c3a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:16.230244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028502e-5ab8-4277-8bfe-a1fad1c15d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:16.231471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028502e-5ab8-4277-8bfe-a1fad1c15d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:16.231721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028502e-5ab8-4277-8bfe-a1fad1c15d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:16.232041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028502e-5ab8-4277-8bfe-a1fad1c15d1c admin admin] PATH_INFO: `/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/e2a6d780d4ee491b933e0eac87c13593/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:16.234340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028502e-5ab8-4277-8bfe-a1fad1c15d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d21a9b5f9fc484b85f6835d9dfddc26, user_id=e2a6d780d4ee491b933e0eac87c13593, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:16.237169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028502e-5ab8-4277-8bfe-a1fad1c15d1c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:16.252792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 588/1169] 10.222.0.41 () {58 vars in 1460 bytes} [Tue Nov 9 04:47:16 2021] PUT /identity/v3/projects/8d21a9b5f9fc484b85f6835d9dfddc26/users/e2a6d780d4ee491b933e0eac87c13593/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:47:18.507800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf508-fe5c-4957-bb80-3a994fff0e83 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.508327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf508-fe5c-4957-bb80-3a994fff0e83 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.508327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcf508-fe5c-4957-bb80-3a994fff0e83 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.510104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 582/1170] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:18.516003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.516422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.516602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.533963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:18.535725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:18.590110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 589/1171] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:18 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:18.615077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf508-fe5c-4957-bb80-3a994fff0e83 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.626869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcf508-fe5c-4957-bb80-3a994fff0e83 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.631242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.632042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.632319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.632586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.642274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 09 04:47:18.649473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 09 04:47:18.650578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 583/1172] 10.222.0.41 () {56 vars in 1117 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:18.656695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.665826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a65e-b3ae-485a-8627-d71518157f5f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.670501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.671146 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.671434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.671771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.672535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:18.672845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.674422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.682497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 590/1173] 10.222.0.41 () {56 vars in 1120 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:18.688948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.699063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe636ad3-c5e9-4964-af4e-f0f6b08813f1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.703405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.704223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.704501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.704772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.714536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.716371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.733295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:18.734444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 584/1174] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:18.741302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.750519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6b5a0-4c03-487d-9f83-adbc9dd76403 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.754942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.755576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.755892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.756173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.756905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:18.757214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.758822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.769976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 591/1175] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:18.775899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.785864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de731960-7971-4fef-bcc8-0191ed7c6697 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.790420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.791183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.791469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.792049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.799128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.801783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.815399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 09 04:47:18.816525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 585/1176] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:18.822328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.831481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f3af3-ad25-4b6f-8749-473490a22d58 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.835920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.836559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.836845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.837123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.837961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:18.838272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.840109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.856944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 592/1177] 10.222.0.41 () {56 vars in 1164 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:18.863244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.872399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfea71f-4cbd-46de-af2d-232fff04a19f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.876845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.877456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.877738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.878017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.885534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.887247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.895727 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 586/1178] 10.222.0.41 () {58 vars in 1324 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:47:18.901429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.911052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010b737-b127-4917-ac1b-5e792d58eb54 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.915443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.916240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.916526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.917061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.927219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.929053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.944894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 09 04:47:18.945992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 593/1179] 10.222.0.41 () {56 vars in 1129 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 09 04:47:18.951707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.960041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a47fed4-49a1-44eb-aa7c-657933f26738 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.964531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:18.965155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:18.965438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:18.965713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:18.966437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:18.966742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:18.968308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:18.979982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 587/1180] 10.222.0.41 () {56 vars in 1130 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:18.985544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:18.995239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507ec830-8c18-483a-b64a-6acea700f7a1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:18.999699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:19.000439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:19.000725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:19.001010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:19.007454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:19.009425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:19.021773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING keystone.server.flask.application [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 09 04:47:19.022988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 594/1181] 10.222.0.41 () {56 vars in 1132 bytes} [Tue Nov 9 04:47:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:19.028600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:19.038355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57f650-0da0-4b5d-bf8e-6355d8dec63f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:19.043070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:19.043726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:19.044013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:19.044292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:19.045078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:19.045387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:19.047184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709f606-0c71-4a43-b1aa-c15f358f13f6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:19.059302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 588/1182] 10.222.0.41 () {56 vars in 1169 bytes} [Tue Nov 9 04:47:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:19.065263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:19.074912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf648dbb-2923-48af-b8ef-f617586a2b62 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:19.079254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:19.079903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:19.080171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:19.080444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:19.081815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] RBAC: Adding query filter params (role.id=94424be31c964c5686644e854119e1dc, scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26, user.id=e2a6d780d4ee491b933e0eac87c13593) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:19.082133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:19.083996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b11628-a346-4b38-824b-4a3f20f80efb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:19.089502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 595/1183] 10.222.0.41 () {56 vars in 1395 bytes} [Tue Nov 9 04:47:19 2021] GET /identity/v3/role_assignments?user.id=e2a6d780d4ee491b933e0eac87c13593&scope.project.id=8d21a9b5f9fc484b85f6835d9dfddc26&role.id=94424be31c964c5686644e854119e1dc => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:21.341170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a573745-52d4-40ad-9365-8d319fc1790b None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:21.341702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a573745-52d4-40ad-9365-8d319fc1790b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:21.341702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a573745-52d4-40ad-9365-8d319fc1790b None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:21.343471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 589/1184] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:21.349489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428371f-5f21-49f4-a446-d32074820beb None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:21.349867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428371f-5f21-49f4-a446-d32074820beb None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:21.350060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428371f-5f21-49f4-a446-d32074820beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:21.367292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3428371f-5f21-49f4-a446-d32074820beb None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:21.368504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3428371f-5f21-49f4-a446-d32074820beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:21.376008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 596/1185] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:47:21.399041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a573745-52d4-40ad-9365-8d319fc1790b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:21.410844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a573745-52d4-40ad-9365-8d319fc1790b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:21.415149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:21.415938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:21.416218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:21.416488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:21.417408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:21.418983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:21.430163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 09 04:47:21.431238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 590/1186] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:47:21 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:21.437428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428371f-5f21-49f4-a446-d32074820beb None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:21.446647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428371f-5f21-49f4-a446-d32074820beb None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:21.451095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:21.451772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:21.452064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:21.452347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:21.453071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:21.453382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:21.454962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f9f3b-df24-44e3-b911-6ccd202e3805 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:21.459633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 597/1187] 10.222.0.41 () {56 vars in 1137 bytes} [Tue Nov 9 04:47:21 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:21.465271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:21.474327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d899afc-2d39-4da3-b025-550effc34e0f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:21.478719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:21.479341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:21.479643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:21.479930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] PATH_INFO: `/v3/services` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:21.480639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:21.480946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:21.482482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f8b79-3e03-4e0b-a2df-620b64cf2a9a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:21.486731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 591/1188] 10.222.0.41 () {56 vars in 1137 bytes} [Tue Nov 9 04:47:21 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:23.866250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dc3fc-115e-46c5-9032-b5966fa7a698 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:23.866763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dc3fc-115e-46c5-9032-b5966fa7a698 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:23.866763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dc3fc-115e-46c5-9032-b5966fa7a698 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:23.868530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 598/1189] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:23.874322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ce58-3ab6-4718-a992-02b7ebc54b63 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:23.874702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ce58-3ab6-4718-a992-02b7ebc54b63 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:23.874874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ce58-3ab6-4718-a992-02b7ebc54b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:23.893136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1273ce58-3ab6-4718-a992-02b7ebc54b63 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:23.894401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1273ce58-3ab6-4718-a992-02b7ebc54b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:23.901879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 592/1190] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:23.926001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dc3fc-115e-46c5-9032-b5966fa7a698 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:23.937914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dc3fc-115e-46c5-9032-b5966fa7a698 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:23.942797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832badff-2f7f-4904-8d9c-8d31d30930a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:23.943440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832badff-2f7f-4904-8d9c-8d31d30930a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:23.943771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832badff-2f7f-4904-8d9c-8d31d30930a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:23.944058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832badff-2f7f-4904-8d9c-8d31d30930a2 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:23.944805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832badff-2f7f-4904-8d9c-8d31d30930a2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:23.946380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832badff-2f7f-4904-8d9c-8d31d30930a2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:23.958742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 599/1191] 10.222.0.41 () {60 vars in 1162 bytes} [Tue Nov 9 04:47:23 2021] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:47:26.274364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c225fa-7eca-49a8-a500-ff8546c88f52 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:26.274931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c225fa-7eca-49a8-a500-ff8546c88f52 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:26.274931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c225fa-7eca-49a8-a500-ff8546c88f52 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:26.276716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 593/1192] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:26.282482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:26.282852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:26.283052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:26.301698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:26.302908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:26.319295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 600/1193] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:26 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:26.342496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c225fa-7eca-49a8-a500-ff8546c88f52 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:26.354859 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c225fa-7eca-49a8-a500-ff8546c88f52 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:26.359163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:26.359974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:26.360260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:26.360545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:26.361212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:26.363376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:26.374039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 09 04:47:26.375131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 594/1194] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:47:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:26.381252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:26.389770 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e054a-9768-453c-9ad7-0f5f32167a54 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:26.394302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:26.394947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:26.395236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:26.395519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:26.396284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:26.396601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:26.398197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:26.403244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 601/1195] 10.222.0.41 () {56 vars in 1137 bytes} [Tue Nov 9 04:47:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:47:26.409034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:26.418829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997630-cec6-415b-9a6c-ac9fc53c44df admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:26.423404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:26.424053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:26.424339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:26.424617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:26.425937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] RBAC: Adding query filter params (interface=public, service_id=51aff2e8e8f74180ac2410343c901b7b, region_id=RegionOne) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:26.426246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:26.427801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cd695-d2f5-43ea-86f6-27b6b78637c2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:26.432522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 595/1196] 10.222.0.41 () {56 vars in 1272 bytes} [Tue Nov 9 04:47:26 2021] GET /identity/v3/endpoints?service_id=51aff2e8e8f74180ac2410343c901b7b&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:26.438120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:26.447143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0f5c9-e70d-40d7-9492-2a8ffc9e6c29 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:26.451540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b862bb6-80a9-4fb2-86cb-b213753e5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:26.452193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862bb6-80a9-4fb2-86cb-b213753e5fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:26.452481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862bb6-80a9-4fb2-86cb-b213753e5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:26.452762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b862bb6-80a9-4fb2-86cb-b213753e5fa5 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:26.453445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862bb6-80a9-4fb2-86cb-b213753e5fa5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:26.454956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b862bb6-80a9-4fb2-86cb-b213753e5fa5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:26.461489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 602/1197] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:47:26 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:47:28.711251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044cbf-850f-418d-8ba8-e35309e7d6d5 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:28.711799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044cbf-850f-418d-8ba8-e35309e7d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:28.711885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2044cbf-850f-418d-8ba8-e35309e7d6d5 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:28.713579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 596/1198] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:47:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:47:28.719515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:28.719969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:28.720127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:28.737239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:47:28.738434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:47:28.746164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 603/1199] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:47:28 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:47:28.774324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2044cbf-850f-418d-8ba8-e35309e7d6d5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:28.786254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2044cbf-850f-418d-8ba8-e35309e7d6d5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:28.790544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:28.791316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:28.791888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:28.792161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:28.792818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:28.794410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:28.805289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING keystone.server.flask.application [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 09 04:47:28.806408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 597/1200] 10.222.0.41 () {56 vars in 1138 bytes} [Tue Nov 9 04:47:28 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 09 04:47:28.812614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:28.821955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1029de-dbcc-45cc-8826-b14950a764f3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:28.826430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:28.827079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:28.827375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:28.827687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] PATH_INFO: `/v3/services` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:28.828416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:47:28.828728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:28.830308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c018aa-c263-40bf-bd17-0885213903b3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:28.835962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 604/1201] 10.222.0.41 () {56 vars in 1137 bytes} [Tue Nov 9 04:47:28 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:47:28.841365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:47:28.851948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c13b79-9522-4101-9785-d773a6fb28c9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:47:28.856396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ebaaf-c542-4507-8f0e-698c0afce306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:47:28.856999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ebaaf-c542-4507-8f0e-698c0afce306 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:47:28.857277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ebaaf-c542-4507-8f0e-698c0afce306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:47:28.857547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ebaaf-c542-4507-8f0e-698c0afce306 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:47:28.858285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ebaaf-c542-4507-8f0e-698c0afce306 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:47:28.859841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ebaaf-c542-4507-8f0e-698c0afce306 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:47:28.877261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 598/1202] 10.222.0.41 () {60 vars in 1165 bytes} [Tue Nov 9 04:47:28 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:48:31.227756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659426c2-eb85-4c31-9df9-a71e72812bae None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:31.228247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659426c2-eb85-4c31-9df9-a71e72812bae None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:31.228247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659426c2-eb85-4c31-9df9-a71e72812bae None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:31.230281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 605/1203] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:31.236566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65980ba-4703-4fac-994e-bc1e6c57eae0 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:31.236969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65980ba-4703-4fac-994e-bc1e6c57eae0 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:31.237061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65980ba-4703-4fac-994e-bc1e6c57eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:31.322982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f65980ba-4703-4fac-994e-bc1e6c57eae0 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:31.324697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f65980ba-4703-4fac-994e-bc1e6c57eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:31.464420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 599/1204] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:31.472428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659426c2-eb85-4c31-9df9-a71e72812bae None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:31.474174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-659426c2-eb85-4c31-9df9-a71e72812bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:31.633744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659426c2-eb85-4c31-9df9-a71e72812bae None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:31.730296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb7397-a0cd-4fda-a073-ff372036b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:31.731404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb7397-a0cd-4fda-a073-ff372036b8af admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:31.731916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb7397-a0cd-4fda-a073-ff372036b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:31.732402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb7397-a0cd-4fda-a073-ff372036b8af admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:31.733341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb7397-a0cd-4fda-a073-ff372036b8af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:31.735499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb7397-a0cd-4fda-a073-ff372036b8af admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:31.755377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 606/1205] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:48:31 2021] GET /identity/v3/projects => generated 2553 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:48:34.063913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f27a93-3f36-48ca-9add-b5bd4856610e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:34.064939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f27a93-3f36-48ca-9add-b5bd4856610e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:34.065431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f27a93-3f36-48ca-9add-b5bd4856610e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:34.072421 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 600/1206] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:34 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:34.074124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1dc40-bb43-4122-a815-f0a88ca7a025 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:34.074551 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1dc40-bb43-4122-a815-f0a88ca7a025 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:34.074688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1dc40-bb43-4122-a815-f0a88ca7a025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:34.154951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-11d1dc40-bb43-4122-a815-f0a88ca7a025 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:34.156231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-11d1dc40-bb43-4122-a815-f0a88ca7a025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:34.255766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 607/1207] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:34.304096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e48f91-a032-4f66-a498-cb9590d2df52 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:34.304383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e48f91-a032-4f66-a498-cb9590d2df52 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:34.304672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e48f91-a032-4f66-a498-cb9590d2df52 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:34.309059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 601/1208] 10.222.0.41 () {54 vars in 964 bytes} [Tue Nov 9 04:48:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:34.316841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f656af-8a55-4a9e-9a2c-5d5889181379 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:34.317136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f656af-8a55-4a9e-9a2c-5d5889181379 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:34.317422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f656af-8a55-4a9e-9a2c-5d5889181379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:34.395749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-63f656af-8a55-4a9e-9a2c-5d5889181379 None None] MFA Rules not processed for user `91a0c407ceb84296be75ad28880f64cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:34.397322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-63f656af-8a55-4a9e-9a2c-5d5889181379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:34.483835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 608/1209] 10.222.0.41 () {58 vars in 1061 bytes} [Tue Nov 9 04:48:34 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:34.485369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e48f91-a032-4f66-a498-cb9590d2df52 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:34.487142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-92e48f91-a032-4f66-a498-cb9590d2df52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:34.625674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e48f91-a032-4f66-a498-cb9590d2df52 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:34.713726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:34.714399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:34.714686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:34.715347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:34.716726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:34.825309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:34.826668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a8f7-24f1-481b-98ee-2b50ec3a3dd5 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:34.845871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 602/1210] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:37.393677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea451f4-a5c0-46db-a898-d5c5a9c1652a None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:37.394239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea451f4-a5c0-46db-a898-d5c5a9c1652a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:37.394239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea451f4-a5c0-46db-a898-d5c5a9c1652a None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:37.396068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 609/1211] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:37.401828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87335762-0619-40d9-b50d-f74ad85f5910 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:37.402256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87335762-0619-40d9-b50d-f74ad85f5910 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:37.402399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87335762-0619-40d9-b50d-f74ad85f5910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:37.466694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-87335762-0619-40d9-b50d-f74ad85f5910 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:37.467931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-87335762-0619-40d9-b50d-f74ad85f5910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:37.560191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 603/1212] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:48:37.600153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea451f4-a5c0-46db-a898-d5c5a9c1652a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:37.601674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8ea451f4-a5c0-46db-a898-d5c5a9c1652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:37.699040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea451f4-a5c0-46db-a898-d5c5a9c1652a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:37.767745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:37.768379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:37.768661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:37.768934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:37.770548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:37.872065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:37.873499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc458e-6fec-40e1-8122-35c8cd9437ea service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:37.891087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 610/1213] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:48:40.416659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9ea0e-025c-4d2a-ab5f-5311d4cdfe10 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:40.417308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9ea0e-025c-4d2a-ab5f-5311d4cdfe10 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:40.417308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9ea0e-025c-4d2a-ab5f-5311d4cdfe10 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:40.418972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 604/1214] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:40.425035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:40.425500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:40.425598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:40.493062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:40.494274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:40.586229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 611/1215] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:40.621499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9ea0e-025c-4d2a-ab5f-5311d4cdfe10 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:40.622976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-09d9ea0e-025c-4d2a-ab5f-5311d4cdfe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:40.742028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9ea0e-025c-4d2a-ab5f-5311d4cdfe10 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:40.829645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dc08d-0d0b-4894-ab43-ba6055fc3ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:40.830486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc08d-0d0b-4894-ab43-ba6055fc3ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:40.830766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc08d-0d0b-4894-ab43-ba6055fc3ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:40.831038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dc08d-0d0b-4894-ab43-ba6055fc3ae5 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:40.840316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dc08d-0d0b-4894-ab43-ba6055fc3ae5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:40.842368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dc08d-0d0b-4894-ab43-ba6055fc3ae5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:40.844082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 605/1216] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:48:40 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:48:40.856573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:40.857771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:40.942630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53843dde-12ad-40c4-ac69-a07651c639ad None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:41.009564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:41.010122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:41.010407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:41.010684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:41.012301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:41.115445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:41.116894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b0dfa-ad84-485f-8e5c-4467f4a463da service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:41.133849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 612/1217] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:43.983811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f6662-b993-4618-a224-36e59d75e2ba None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:43.984865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f6662-b993-4618-a224-36e59d75e2ba None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:43.984865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f6662-b993-4618-a224-36e59d75e2ba None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:43.986630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 606/1218] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:43.992477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:43.992876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:43.993028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:44.054758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:44.056244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:44.146592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 613/1219] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:44.181147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f6662-b993-4618-a224-36e59d75e2ba None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:44.182614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-243f6662-b993-4618-a224-36e59d75e2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:44.303103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f6662-b993-4618-a224-36e59d75e2ba None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:44.390316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d175f-02ea-409f-be18-53ca40405460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:44.391178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d175f-02ea-409f-be18-53ca40405460 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:44.391459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d175f-02ea-409f-be18-53ca40405460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:44.391767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d175f-02ea-409f-be18-53ca40405460 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:44.401177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d175f-02ea-409f-be18-53ca40405460 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:44.403221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d175f-02ea-409f-be18-53ca40405460 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:44.404911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 607/1220] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:48:44 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:48:44.417777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:44.418966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:44.505075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e256232-16a1-4483-a1d9-889412d81468 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:44.573485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:44.574162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:44.574449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:44.574730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:44.576388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:44.678627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:44.680087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c15453-6224-4157-bb76-dee0ef4e1c05 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:44.698059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 614/1221] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:47.604287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55dbf7-d6cf-466d-9b77-7c81357ae6d1 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:47.604830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55dbf7-d6cf-466d-9b77-7c81357ae6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:47.604830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55dbf7-d6cf-466d-9b77-7c81357ae6d1 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:47.606628 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 608/1222] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:47.613128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01bb2-4a1c-4731-9ffc-6ce11750bef3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:47.613619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01bb2-4a1c-4731-9ffc-6ce11750bef3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:47.613706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c01bb2-4a1c-4731-9ffc-6ce11750bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:47.679127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-25c01bb2-4a1c-4731-9ffc-6ce11750bef3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:47.680407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-25c01bb2-4a1c-4731-9ffc-6ce11750bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:47.773661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 615/1223] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:47.811006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55dbf7-d6cf-466d-9b77-7c81357ae6d1 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:47.812521 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-aa55dbf7-d6cf-466d-9b77-7c81357ae6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:47.910918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55dbf7-d6cf-466d-9b77-7c81357ae6d1 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:47.980533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:47.981186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:47.981472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:47.981746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:47.983359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:48.087978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:48.089336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad6a47a-209a-4730-a5d2-380fa66071c8 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:48.106517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 609/1224] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:50.394733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e7ec-5f31-45c7-8219-76b52cfc6fcd None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:50.395294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e7ec-5f31-45c7-8219-76b52cfc6fcd None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:50.395294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e7ec-5f31-45c7-8219-76b52cfc6fcd None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:50.397141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 616/1225] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:50.403168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351da1-9baa-4e8b-a475-e3360d2ae4fb None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:50.403576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351da1-9baa-4e8b-a475-e3360d2ae4fb None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:50.403757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55351da1-9baa-4e8b-a475-e3360d2ae4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:50.465954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-55351da1-9baa-4e8b-a475-e3360d2ae4fb None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:50.467148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-55351da1-9baa-4e8b-a475-e3360d2ae4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:50.560137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 610/1226] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:50.613371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b02a-c0e1-4237-b092-1f85dff8149f None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:50.613664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b02a-c0e1-4237-b092-1f85dff8149f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:50.613951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624b02a-c0e1-4237-b092-1f85dff8149f None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:50.615799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 617/1227] 10.222.0.41 () {54 vars in 964 bytes} [Tue Nov 9 04:48:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:50.622344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502acee2-99db-405a-922c-a6a3f2afe9da None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:50.622630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502acee2-99db-405a-922c-a6a3f2afe9da None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:50.622902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502acee2-99db-405a-922c-a6a3f2afe9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:50.695587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-502acee2-99db-405a-922c-a6a3f2afe9da None None] MFA Rules not processed for user `91a0c407ceb84296be75ad28880f64cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:50.696808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-502acee2-99db-405a-922c-a6a3f2afe9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:50.771298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 611/1228] 10.222.0.41 () {58 vars in 1061 bytes} [Tue Nov 9 04:48:50 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:50.781782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b02a-c0e1-4237-b092-1f85dff8149f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:50.783342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1624b02a-c0e1-4237-b092-1f85dff8149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:50.883757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624b02a-c0e1-4237-b092-1f85dff8149f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:50.953175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:50.953751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:50.954035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:50.954313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:50.955966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:51.057490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:51.058928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e4b6a-d2c4-4aa0-a128-5f4bc6e4112e service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:51.075978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 618/1229] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:53.614102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31521e-55cb-4ecf-8ecf-ff235e20caad None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:53.614603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31521e-55cb-4ecf-8ecf-ff235e20caad None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:53.614706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31521e-55cb-4ecf-8ecf-ff235e20caad None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:53.616509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 612/1230] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:53.622514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:53.622903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:53.623187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:53.686073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:53.687289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:53.780123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 619/1231] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:53.815063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31521e-55cb-4ecf-8ecf-ff235e20caad None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:53.817402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0a31521e-55cb-4ecf-8ecf-ff235e20caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:53.941650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31521e-55cb-4ecf-8ecf-ff235e20caad None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:54.031785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970aa0d-9594-4db2-8f63-50b03000ff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:54.032569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970aa0d-9594-4db2-8f63-50b03000ff28 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:54.032847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970aa0d-9594-4db2-8f63-50b03000ff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:54.033118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970aa0d-9594-4db2-8f63-50b03000ff28 admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:54.042672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970aa0d-9594-4db2-8f63-50b03000ff28 admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:54.044772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970aa0d-9594-4db2-8f63-50b03000ff28 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:54.046602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 613/1232] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:48:53 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:48:54.058725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:54.059945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:54.157116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2710e3e-97ec-4fcc-97d6-703d201d14a8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:54.236200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:54.236866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:54.237151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:54.237431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:54.239074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:54.342586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:54.344130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5ac73-1285-43b0-a3c6-128cb8c14b16 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:54.361761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 620/1233] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:57.063389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ab8e-5bdc-450e-a273-a81048d2966f None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:57.063973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ab8e-5bdc-450e-a273-a81048d2966f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:57.063973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ab8e-5bdc-450e-a273-a81048d2966f None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:57.065743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 614/1234] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:57.071554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372ac8-e8a5-4942-8151-7db0adcf700a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:57.072037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372ac8-e8a5-4942-8151-7db0adcf700a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:57.072133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e372ac8-e8a5-4942-8151-7db0adcf700a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:57.134597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6e372ac8-e8a5-4942-8151-7db0adcf700a None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:57.135859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6e372ac8-e8a5-4942-8151-7db0adcf700a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:57.227021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 621/1235] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:48:57.265396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ab8e-5bdc-450e-a273-a81048d2966f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:48:57.266910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8013ab8e-5bdc-450e-a273-a81048d2966f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:57.365352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ab8e-5bdc-450e-a273-a81048d2966f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:48:57.434057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:48:57.434693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:57.434975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:57.435250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:57.436878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:48:57.543281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:48:57.544770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3f4753-fa62-463c-bc78-75ca25e5c316 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:48:57.562754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 615/1236] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:48:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:48:59.850044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199a5f-fe5a-4b12-b02d-c821233d028c None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:59.850548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199a5f-fe5a-4b12-b02d-c821233d028c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:59.850548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50199a5f-fe5a-4b12-b02d-c821233d028c None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:59.852730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 622/1237] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:48:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:48:59.858594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580a933-ea90-4ade-aaf3-0b59c0052e02 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:48:59.859030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580a933-ea90-4ade-aaf3-0b59c0052e02 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:48:59.859159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580a933-ea90-4ade-aaf3-0b59c0052e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:48:59.921536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8580a933-ea90-4ade-aaf3-0b59c0052e02 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:48:59.922729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8580a933-ea90-4ade-aaf3-0b59c0052e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:00.013583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 616/1238] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:48:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:00.055230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50199a5f-fe5a-4b12-b02d-c821233d028c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:00.056786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-50199a5f-fe5a-4b12-b02d-c821233d028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:00.153514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50199a5f-fe5a-4b12-b02d-c821233d028c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:00.223241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:00.223991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:00.224277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:00.224554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:00.226175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:00.331720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:00.333161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe02d4-82b6-463d-85a0-0fdea887ee5d service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:00.350354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 623/1239] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:03.056141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f20ee-acb6-401c-a7a4-cc22a027fcc7 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:03.056664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f20ee-acb6-401c-a7a4-cc22a027fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:03.056769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f20ee-acb6-401c-a7a4-cc22a027fcc7 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:03.058477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 617/1240] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:03.064407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dffbe9-e092-4e51-bfea-0d4847e4e26f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:03.064846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dffbe9-e092-4e51-bfea-0d4847e4e26f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:03.064977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dffbe9-e092-4e51-bfea-0d4847e4e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:03.132409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-79dffbe9-e092-4e51-bfea-0d4847e4e26f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:03.133610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-79dffbe9-e092-4e51-bfea-0d4847e4e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:03.232849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 624/1241] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:03.269778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f20ee-acb6-401c-a7a4-cc22a027fcc7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:03.271890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2d3f20ee-acb6-401c-a7a4-cc22a027fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:03.361307 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f20ee-acb6-401c-a7a4-cc22a027fcc7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:03.364820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2a586-c07d-450c-aaa8-60a3f6143af4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:03.365453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a586-c07d-450c-aaa8-60a3f6143af4 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:03.365739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a586-c07d-450c-aaa8-60a3f6143af4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:03.366016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2a586-c07d-450c-aaa8-60a3f6143af4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:03.374548 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2a586-c07d-450c-aaa8-60a3f6143af4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:03.376003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2a586-c07d-450c-aaa8-60a3f6143af4 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:03.384973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 618/1242] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:07.545213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd329e97-28e5-452a-9f09-154f5dff692e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:07.545749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd329e97-28e5-452a-9f09-154f5dff692e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:07.545842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd329e97-28e5-452a-9f09-154f5dff692e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:07.547573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 625/1243] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:07.553425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d766-6beb-4ad4-ac72-515870b5b4dd None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:07.554229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d766-6beb-4ad4-ac72-515870b5b4dd None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:07.554511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d766-6beb-4ad4-ac72-515870b5b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:07.572388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8b27d766-6beb-4ad4-ac72-515870b5b4dd None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:07.573605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8b27d766-6beb-4ad4-ac72-515870b5b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:07.582000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 619/1244] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:07.621588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd329e97-28e5-452a-9f09-154f5dff692e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:07.632445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd329e97-28e5-452a-9f09-154f5dff692e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:07.636178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da57f4-bccb-4903-8dcc-29e84175d403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:07.636828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da57f4-bccb-4903-8dcc-29e84175d403 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:07.637121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da57f4-bccb-4903-8dcc-29e84175d403 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:07.637403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da57f4-bccb-4903-8dcc-29e84175d403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:07.646902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da57f4-bccb-4903-8dcc-29e84175d403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:07.648378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da57f4-bccb-4903-8dcc-29e84175d403 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:07.658015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 626/1245] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:10.478191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fead2-1306-4a71-bd96-0e1940061ed7 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:10.478823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fead2-1306-4a71-bd96-0e1940061ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:10.478823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6fead2-1306-4a71-bd96-0e1940061ed7 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:10.480555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 620/1246] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:10.486441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1cf1-e457-4b10-9abb-489f98d24291 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:10.486846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1cf1-e457-4b10-9abb-489f98d24291 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:10.487007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1cf1-e457-4b10-9abb-489f98d24291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:10.504792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-091a1cf1-e457-4b10-9abb-489f98d24291 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:10.505984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-091a1cf1-e457-4b10-9abb-489f98d24291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:10.514641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 627/1247] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:10.552293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fead2-1306-4a71-bd96-0e1940061ed7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:10.563844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6fead2-1306-4a71-bd96-0e1940061ed7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:10.567384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478595f-0ef2-47ee-a955-6fa620068700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:10.568127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478595f-0ef2-47ee-a955-6fa620068700 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:10.568807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478595f-0ef2-47ee-a955-6fa620068700 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:10.568807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478595f-0ef2-47ee-a955-6fa620068700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:10.577714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478595f-0ef2-47ee-a955-6fa620068700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:10.579140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478595f-0ef2-47ee-a955-6fa620068700 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:10.588279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 621/1248] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:14.870441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe69fd-10fe-48db-84f5-1ab211aadeb8 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:14.870993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe69fd-10fe-48db-84f5-1ab211aadeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:14.871087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe69fd-10fe-48db-84f5-1ab211aadeb8 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:14.872941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 628/1249] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:14.878941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf7bfe-0272-4d23-81de-64cc0b4c4dc9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:14.879319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf7bfe-0272-4d23-81de-64cc0b4c4dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:14.879456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf7bfe-0272-4d23-81de-64cc0b4c4dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:14.898602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-63bf7bfe-0272-4d23-81de-64cc0b4c4dc9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:14.899871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-63bf7bfe-0272-4d23-81de-64cc0b4c4dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:14.908284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 622/1250] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:14.947558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe69fd-10fe-48db-84f5-1ab211aadeb8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:14.958649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe69fd-10fe-48db-84f5-1ab211aadeb8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:14.962636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f7d4d-d449-4189-9f3c-1165411d6ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:14.963283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f7d4d-d449-4189-9f3c-1165411d6ccb service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:14.963569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f7d4d-d449-4189-9f3c-1165411d6ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:14.963880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f7d4d-d449-4189-9f3c-1165411d6ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:14.973068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f7d4d-d449-4189-9f3c-1165411d6ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:14.974521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f7d4d-d449-4189-9f3c-1165411d6ccb service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:14.984114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 629/1251] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:19.948101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e7ada-bbc3-4ea9-a38e-18b9f2a68d30 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:19.948101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e7ada-bbc3-4ea9-a38e-18b9f2a68d30 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:19.948101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e7ada-bbc3-4ea9-a38e-18b9f2a68d30 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:19.948101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 623/1252] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 04:49:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:19.948638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cccf-a295-4d79-b02b-6dbde07a6a1b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:19.948638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cccf-a295-4d79-b02b-6dbde07a6a1b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:19.948638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212cccf-a295-4d79-b02b-6dbde07a6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:20.055720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5212cccf-a295-4d79-b02b-6dbde07a6a1b None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:20.055720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5212cccf-a295-4d79-b02b-6dbde07a6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:20.127126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 630/1253] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 04:49:19 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:24.385380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2383-1c2e-4eaa-b6ca-4ae88c21d651 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:24.385927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2383-1c2e-4eaa-b6ca-4ae88c21d651 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:24.385927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2383-1c2e-4eaa-b6ca-4ae88c21d651 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:24.387982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 624/1254] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 04:49:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:24.393808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672ade-be67-4af2-95d4-c08edcdba29a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:24.394228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672ade-be67-4af2-95d4-c08edcdba29a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:24.394459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34672ade-be67-4af2-95d4-c08edcdba29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:24.412952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-34672ade-be67-4af2-95d4-c08edcdba29a None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:24.414413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-34672ade-be67-4af2-95d4-c08edcdba29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:24.423657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 631/1255] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 04:49:24 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:25.930856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193a44f-16e5-4c47-ac2a-d2d156a03b27 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:25.931409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193a44f-16e5-4c47-ac2a-d2d156a03b27 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:25.931409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193a44f-16e5-4c47-ac2a-d2d156a03b27 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:25.933212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 625/1256] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 04:49:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:25.938860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea527-3ac1-4cb9-a837-86c501a4277c None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:25.939277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea527-3ac1-4cb9-a837-86c501a4277c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:25.939411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea527-3ac1-4cb9-a837-86c501a4277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:25.957291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d99ea527-3ac1-4cb9-a837-86c501a4277c None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:25.958460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d99ea527-3ac1-4cb9-a837-86c501a4277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:25.966879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 632/1257] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 04:49:25 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:49:29.770174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64eb41c-bb89-4316-90a9-b9ac440e7243 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:29.770700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64eb41c-bb89-4316-90a9-b9ac440e7243 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:29.770779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64eb41c-bb89-4316-90a9-b9ac440e7243 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:29.772539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 626/1258] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:29.778510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17dcb-f339-429e-b656-84bd810f4b2b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:29.779495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17dcb-f339-429e-b656-84bd810f4b2b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:29.779653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17dcb-f339-429e-b656-84bd810f4b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:29.797962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-94f17dcb-f339-429e-b656-84bd810f4b2b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:29.799294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-94f17dcb-f339-429e-b656-84bd810f4b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:29.808060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 633/1259] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:29.858606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc62fd-ddb8-4e52-8c0d-c7a644b49a92 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:29.859102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc62fd-ddb8-4e52-8c0d-c7a644b49a92 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:29.859503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc62fd-ddb8-4e52-8c0d-c7a644b49a92 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:29.861403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 627/1260] 10.222.0.41 () {54 vars in 960 bytes} [Tue Nov 9 04:49:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:29.867158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f86b2-0cf7-42a5-8be6-5a63020d62cc None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:29.867559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f86b2-0cf7-42a5-8be6-5a63020d62cc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:29.868000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f86b2-0cf7-42a5-8be6-5a63020d62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:29.919355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-117f86b2-0cf7-42a5-8be6-5a63020d62cc None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:29.920554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-117f86b2-0cf7-42a5-8be6-5a63020d62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:29.998755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 634/1261] 10.222.0.41 () {58 vars in 1057 bytes} [Tue Nov 9 04:49:29 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:30.008404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc62fd-ddb8-4e52-8c0d-c7a644b49a92 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:30.024269 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc62fd-ddb8-4e52-8c0d-c7a644b49a92 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:30.029766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646276ea-49e9-4364-8218-d0582e7ff28b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:30.030411 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646276ea-49e9-4364-8218-d0582e7ff28b service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:30.030690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646276ea-49e9-4364-8218-d0582e7ff28b service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:30.030965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646276ea-49e9-4364-8218-d0582e7ff28b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:30.039791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646276ea-49e9-4364-8218-d0582e7ff28b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:30.041375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646276ea-49e9-4364-8218-d0582e7ff28b service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:30.051361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 628/1262] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:32.529289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd5e4-3cd5-44a7-bb0a-311a86ab0c9d None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:32.530323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd5e4-3cd5-44a7-bb0a-311a86ab0c9d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:32.531252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd5e4-3cd5-44a7-bb0a-311a86ab0c9d None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:32.533411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 635/1263] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:32.539656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0e403-3d94-491a-a6c3-9962a864f3aa None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:32.540123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0e403-3d94-491a-a6c3-9962a864f3aa None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:32.540201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0e403-3d94-491a-a6c3-9962a864f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:32.559605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ebe0e403-3d94-491a-a6c3-9962a864f3aa None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:32.560833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ebe0e403-3d94-491a-a6c3-9962a864f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:32.571983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 629/1264] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:32.619109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd5e4-3cd5-44a7-bb0a-311a86ab0c9d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:32.633743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd5e4-3cd5-44a7-bb0a-311a86ab0c9d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:32.640513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034c145-1433-459f-842e-5e73718e6d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:32.641328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c145-1433-459f-842e-5e73718e6d6d service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:32.641781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c145-1433-459f-842e-5e73718e6d6d service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:32.642225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034c145-1433-459f-842e-5e73718e6d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:32.651320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034c145-1433-459f-842e-5e73718e6d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:32.653130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034c145-1433-459f-842e-5e73718e6d6d service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:32.663703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 636/1265] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:35.237751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839421d-688a-46b6-afb2-87d6c0a8bd78 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:35.238154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839421d-688a-46b6-afb2-87d6c0a8bd78 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:35.238625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839421d-688a-46b6-afb2-87d6c0a8bd78 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:35.240015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 630/1266] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:35.246204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596baeb5-be76-4479-a693-0d2a150577ab None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:35.246709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596baeb5-be76-4479-a693-0d2a150577ab None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:35.246800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596baeb5-be76-4479-a693-0d2a150577ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:35.275701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-596baeb5-be76-4479-a693-0d2a150577ab None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:35.276845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-596baeb5-be76-4479-a693-0d2a150577ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:35.286176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 637/1267] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:35.334787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2e80a-6fca-4b3c-a201-10491bc56ea3 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:35.335104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2e80a-6fca-4b3c-a201-10491bc56ea3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:35.335389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2e80a-6fca-4b3c-a201-10491bc56ea3 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:35.337390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 631/1268] 10.222.0.41 () {54 vars in 960 bytes} [Tue Nov 9 04:49:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:35.343831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57dec-dabf-448c-96f9-004f75e355d1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:35.344122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57dec-dabf-448c-96f9-004f75e355d1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:35.344407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57dec-dabf-448c-96f9-004f75e355d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:35.364415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-43b57dec-dabf-448c-96f9-004f75e355d1 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:35.365527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-43b57dec-dabf-448c-96f9-004f75e355d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:35.374798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 638/1269] 10.222.0.41 () {58 vars in 1057 bytes} [Tue Nov 9 04:49:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:35.384275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2e80a-6fca-4b3c-a201-10491bc56ea3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:35.402850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2e80a-6fca-4b3c-a201-10491bc56ea3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:35.410977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924c09f-015f-43db-bd2f-8e284f516af2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:35.411790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924c09f-015f-43db-bd2f-8e284f516af2 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:35.412314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924c09f-015f-43db-bd2f-8e284f516af2 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:35.412655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924c09f-015f-43db-bd2f-8e284f516af2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:35.422362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924c09f-015f-43db-bd2f-8e284f516af2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:35.424224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924c09f-015f-43db-bd2f-8e284f516af2 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:35.435870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 632/1270] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:37.648183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e65e42-0e39-44e2-9a23-c47a76108f95 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.648761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e65e42-0e39-44e2-9a23-c47a76108f95 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.648761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e65e42-0e39-44e2-9a23-c47a76108f95 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.651740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 639/1271] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:37.657624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd9e3-f863-4f72-832c-a87427d176a6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.658191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd9e3-f863-4f72-832c-a87427d176a6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.658191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bd9e3-f863-4f72-832c-a87427d176a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.676341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ec8bd9e3-f863-4f72-832c-a87427d176a6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:37.677516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ec8bd9e3-f863-4f72-832c-a87427d176a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:37.686109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 633/1272] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:37.741164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3660-b237-41f7-9103-de8b67529a56 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.741696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3660-b237-41f7-9103-de8b67529a56 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.742120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3660-b237-41f7-9103-de8b67529a56 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.744151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 640/1273] 10.222.0.41 () {54 vars in 962 bytes} [Tue Nov 9 04:49:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:37.751429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.752015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.752439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.776508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44c49-3d33-424f-9285-aeca2adc6d20 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.776804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44c49-3d33-424f-9285-aeca2adc6d20 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.776987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f44c49-3d33-424f-9285-aeca2adc6d20 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.778936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 641/1274] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:49:37.785017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.785523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.785806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.804419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:37.805750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:37.806346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] MFA Rules not processed for user `e261119c7a194c7e814a9dfbf6a4b10f`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:37.807614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:37.814522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 642/1275] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:37.862351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:37.868707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 634/1276] 10.222.0.41 () {58 vars in 1059 bytes} [Tue Nov 9 04:49:37 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:37.876764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:37.876939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306dac9f-24d8-4b58-b71f-0b4c121383f7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:37.882565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f46eae-5c3a-44de-a52b-b9bc66364e83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:37.883223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f46eae-5c3a-44de-a52b-b9bc66364e83 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.883512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f46eae-5c3a-44de-a52b-b9bc66364e83 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.883961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8181c-eb64-48fb-9b9f-add65aaaaf94 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:37.884070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f46eae-5c3a-44de-a52b-b9bc66364e83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.887615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05e3a5-784f-4013-8303-52482b3f908d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:37.888799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e3a5-784f-4013-8303-52482b3f908d service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:37.889079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e3a5-784f-4013-8303-52482b3f908d service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:37.889352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05e3a5-784f-4013-8303-52482b3f908d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:37.894575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f46eae-5c3a-44de-a52b-b9bc66364e83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:37.896882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f46eae-5c3a-44de-a52b-b9bc66364e83 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:37.898256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05e3a5-784f-4013-8303-52482b3f908d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:37.899699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05e3a5-784f-4013-8303-52482b3f908d service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:37.908106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 643/1277] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:37.909667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 635/1278] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:49:40.254796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d7ab0-a996-4afd-ad78-11ab2bba3758 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:40.255427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d7ab0-a996-4afd-ad78-11ab2bba3758 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:40.255427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d7ab0-a996-4afd-ad78-11ab2bba3758 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:40.257085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 644/1279] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:40.263436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638503-2ac7-4998-9ccc-b1899fa3c891 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:40.263895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638503-2ac7-4998-9ccc-b1899fa3c891 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:40.264033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638503-2ac7-4998-9ccc-b1899fa3c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:40.281841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7a638503-2ac7-4998-9ccc-b1899fa3c891 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:40.283003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7a638503-2ac7-4998-9ccc-b1899fa3c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:40.290954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 636/1280] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:49:40.341901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d7ab0-a996-4afd-ad78-11ab2bba3758 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:40.355978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d7ab0-a996-4afd-ad78-11ab2bba3758 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:40.361388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad4b0-6da0-48f7-931a-8180f9b6b95a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:40.362034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad4b0-6da0-48f7-931a-8180f9b6b95a service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:40.362347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad4b0-6da0-48f7-931a-8180f9b6b95a service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:40.362625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad4b0-6da0-48f7-931a-8180f9b6b95a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:40.370537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad4b0-6da0-48f7-931a-8180f9b6b95a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:40.372203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad4b0-6da0-48f7-931a-8180f9b6b95a service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:40.381379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 645/1281] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:42.740245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea02c4-14ab-4756-8ef7-dc30cea7571e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:42.740684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea02c4-14ab-4756-8ef7-dc30cea7571e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:42.741014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea02c4-14ab-4756-8ef7-dc30cea7571e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:42.742933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 637/1282] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:42.749467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02fe0b-da65-4787-8274-59ce92f43f37 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:42.749920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02fe0b-da65-4787-8274-59ce92f43f37 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:42.750034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02fe0b-da65-4787-8274-59ce92f43f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:42.768412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2a02fe0b-da65-4787-8274-59ce92f43f37 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:42.769595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2a02fe0b-da65-4787-8274-59ce92f43f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:42.778678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 646/1283] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:42.824366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea02c4-14ab-4756-8ef7-dc30cea7571e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:42.839541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea02c4-14ab-4756-8ef7-dc30cea7571e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:42.845207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d18bfd-8c63-4fc6-af0e-64f3754233d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:42.845932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d18bfd-8c63-4fc6-af0e-64f3754233d1 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:42.846400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d18bfd-8c63-4fc6-af0e-64f3754233d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:42.846759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d18bfd-8c63-4fc6-af0e-64f3754233d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:42.855517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d18bfd-8c63-4fc6-af0e-64f3754233d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:42.857381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d18bfd-8c63-4fc6-af0e-64f3754233d1 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:42.867976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 638/1284] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:45.243493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4bf3-3a49-4cca-8ea4-b1c591aab400 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:45.244125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4bf3-3a49-4cca-8ea4-b1c591aab400 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:45.244588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df4bf3-3a49-4cca-8ea4-b1c591aab400 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:45.248073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 647/1285] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:45 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:45.258042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75d294-2e93-4f98-9039-44db7e9c628f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:45.258505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75d294-2e93-4f98-9039-44db7e9c628f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:45.258614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75d294-2e93-4f98-9039-44db7e9c628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:45.278757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-fd75d294-2e93-4f98-9039-44db7e9c628f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:45.280055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fd75d294-2e93-4f98-9039-44db7e9c628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:45.288615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 639/1286] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:45.339504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4bf3-3a49-4cca-8ea4-b1c591aab400 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:45.354707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df4bf3-3a49-4cca-8ea4-b1c591aab400 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:45.360493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b118bf8-a98f-4a66-ad6b-cdba927ef7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:45.361144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b118bf8-a98f-4a66-ad6b-cdba927ef7cb service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:45.361432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b118bf8-a98f-4a66-ad6b-cdba927ef7cb service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:45.361712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b118bf8-a98f-4a66-ad6b-cdba927ef7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:45.370612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b118bf8-a98f-4a66-ad6b-cdba927ef7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:45.372263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b118bf8-a98f-4a66-ad6b-cdba927ef7cb service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:45.382339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 648/1287] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:49:48.671059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abd923-1b1a-40e5-80b1-843180175f1b None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:48.671642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abd923-1b1a-40e5-80b1-843180175f1b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:48.671999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abd923-1b1a-40e5-80b1-843180175f1b None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:48.674773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 640/1288] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:48.680948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701576-de6b-4351-aff0-80dfd78fffef None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:48.681346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701576-de6b-4351-aff0-80dfd78fffef None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:48.681510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82701576-de6b-4351-aff0-80dfd78fffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:48.700565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-82701576-de6b-4351-aff0-80dfd78fffef None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:48.701760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-82701576-de6b-4351-aff0-80dfd78fffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:48.709534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 649/1289] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:48.759678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abd923-1b1a-40e5-80b1-843180175f1b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:48.774524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abd923-1b1a-40e5-80b1-843180175f1b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:48.780713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7e5d3-27ab-4425-b55f-be11ce963bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:48.781346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e5d3-27ab-4425-b55f-be11ce963bd4 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:48.781629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e5d3-27ab-4425-b55f-be11ce963bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:48.782096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e5d3-27ab-4425-b55f-be11ce963bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:48.790575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7e5d3-27ab-4425-b55f-be11ce963bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:48.792196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7e5d3-27ab-4425-b55f-be11ce963bd4 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:48.802088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 641/1290] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:49:51.102136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc26c2-5eb3-4164-892a-041537706aa9 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:51.102712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc26c2-5eb3-4164-892a-041537706aa9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:51.102712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc26c2-5eb3-4164-892a-041537706aa9 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:51.104517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 650/1291] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:49:51.110471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad26f-70fc-4bf0-b70d-87faa19958f2 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:51.110901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad26f-70fc-4bf0-b70d-87faa19958f2 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:51.111064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ad26f-70fc-4bf0-b70d-87faa19958f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:51.128962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6b0ad26f-70fc-4bf0-b70d-87faa19958f2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:51.130122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6b0ad26f-70fc-4bf0-b70d-87faa19958f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:51.138220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 642/1292] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:49:51.183199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc26c2-5eb3-4164-892a-041537706aa9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:51.197447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc26c2-5eb3-4164-892a-041537706aa9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:51.203286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f22c1f-5d68-4d55-afff-077fb15aca11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:51.203952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22c1f-5d68-4d55-afff-077fb15aca11 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:51.204237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22c1f-5d68-4d55-afff-077fb15aca11 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:51.204585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f22c1f-5d68-4d55-afff-077fb15aca11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:51.212637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22c1f-5d68-4d55-afff-077fb15aca11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:51.214206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f22c1f-5d68-4d55-afff-077fb15aca11 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:51.224359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 651/1293] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:53.101162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fbb39-5683-4013-b2ab-487f01a4f321 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.101719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fbb39-5683-4013-b2ab-487f01a4f321 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.101719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fbb39-5683-4013-b2ab-487f01a4f321 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.104123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 643/1294] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:53.110589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32e8d-cfd1-4e84-8cd0-fc417bc284af None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.111047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32e8d-cfd1-4e84-8cd0-fc417bc284af None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.111179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e32e8d-cfd1-4e84-8cd0-fc417bc284af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.129319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-62e32e8d-cfd1-4e84-8cd0-fc417bc284af None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:53.130576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-62e32e8d-cfd1-4e84-8cd0-fc417bc284af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:53.138308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 652/1295] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:49:53.198079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47561e43-7f1b-43a3-ac22-9ab00b5f65dd None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.198440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47561e43-7f1b-43a3-ac22-9ab00b5f65dd None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.198791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47561e43-7f1b-43a3-ac22-9ab00b5f65dd None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.200707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 644/1296] 10.222.0.41 () {54 vars in 962 bytes} [Tue Nov 9 04:49:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:53.206825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814a99-c5c6-4c54-a766-d342745310b0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.207171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814a99-c5c6-4c54-a766-d342745310b0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.207489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814a99-c5c6-4c54-a766-d342745310b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.254468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ab814a99-c5c6-4c54-a766-d342745310b0 None None] MFA Rules not processed for user `0cef991f3ef34b09ad2251ef7e416a91`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:53.255699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ab814a99-c5c6-4c54-a766-d342745310b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:53.312995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 653/1297] 10.222.0.41 () {58 vars in 1059 bytes} [Tue Nov 9 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:49:53.321027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47561e43-7f1b-43a3-ac22-9ab00b5f65dd None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:53.331899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47561e43-7f1b-43a3-ac22-9ab00b5f65dd None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:53.336017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64656bce-bd66-43a4-abb4-655b2894ccb2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:53.336358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656bce-bd66-43a4-abb4-655b2894ccb2 service glance] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.336643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656bce-bd66-43a4-abb4-655b2894ccb2 service glance] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.336936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64656bce-bd66-43a4-abb4-655b2894ccb2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.347286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64656bce-bd66-43a4-abb4-655b2894ccb2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:53.348793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64656bce-bd66-43a4-abb4-655b2894ccb2 service glance] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:53.360347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 645/1298] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:53.474297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827caacd-993e-4835-a241-e1a96ca20273 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.474595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827caacd-993e-4835-a241-e1a96ca20273 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.474877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827caacd-993e-4835-a241-e1a96ca20273 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.476750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 654/1299] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:53.483557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70df7a-cd1c-4cbd-9967-bf7838bc39ec None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.483886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70df7a-cd1c-4cbd-9967-bf7838bc39ec None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.484163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70df7a-cd1c-4cbd-9967-bf7838bc39ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.502243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-df70df7a-cd1c-4cbd-9967-bf7838bc39ec None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:53.503550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-df70df7a-cd1c-4cbd-9967-bf7838bc39ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:53.511527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 646/1300] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:53.558161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827caacd-993e-4835-a241-e1a96ca20273 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:53.577534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827caacd-993e-4835-a241-e1a96ca20273 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:53.587147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98991e-f91f-4913-949a-bb738bb930c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:53.587919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98991e-f91f-4913-949a-bb738bb930c9 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.588206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98991e-f91f-4913-949a-bb738bb930c9 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.588481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98991e-f91f-4913-949a-bb738bb930c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.597973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98991e-f91f-4913-949a-bb738bb930c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:53.599554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98991e-f91f-4913-949a-bb738bb930c9 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:53.608716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 655/1301] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:53.805344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8b32-2613-48e5-abc8-2ba4a27defbb None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.805734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8b32-2613-48e5-abc8-2ba4a27defbb None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.806099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8b32-2613-48e5-abc8-2ba4a27defbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.858376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ad2d8b32-2613-48e5-abc8-2ba4a27defbb None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:53.859583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ad2d8b32-2613-48e5-abc8-2ba4a27defbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:53.921826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 647/1302] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:53.965139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdb831-ad69-471a-ab62-f237484e3b31 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.965510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdb831-ad69-471a-ab62-f237484e3b31 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.965861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdb831-ad69-471a-ab62-f237484e3b31 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:53.967767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 656/1303] 10.222.0.41 () {54 vars in 942 bytes} [Tue Nov 9 04:49:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:53.974854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc33e6-72d8-49c9-bae6-59f58f1fb876 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:53.975179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc33e6-72d8-49c9-bae6-59f58f1fb876 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:53.975467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc33e6-72d8-49c9-bae6-59f58f1fb876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:54.023044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-42dc33e6-72d8-49c9-bae6-59f58f1fb876 None None] MFA Rules not processed for user `b400457cc4a343f6a25e43f6d24edc42`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:54.024286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-42dc33e6-72d8-49c9-bae6-59f58f1fb876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:54.092244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 648/1304] 10.222.0.41 () {58 vars in 1039 bytes} [Tue Nov 9 04:49:53 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:54.101428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdb831-ad69-471a-ab62-f237484e3b31 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:54.114404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdb831-ad69-471a-ab62-f237484e3b31 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:54.119274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76caa32-7b51-497d-b7ce-711d2ec21746 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:54.119936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76caa32-7b51-497d-b7ce-711d2ec21746 service swift] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:54.120231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76caa32-7b51-497d-b7ce-711d2ec21746 service swift] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:54.120513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76caa32-7b51-497d-b7ce-711d2ec21746 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:54.128991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76caa32-7b51-497d-b7ce-711d2ec21746 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:54.130573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76caa32-7b51-497d-b7ce-711d2ec21746 service swift] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:54.139167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 657/1305] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:49:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:49:55.901932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c1f9-7775-4cc7-89cc-545497c29f67 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:55.903171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c1f9-7775-4cc7-89cc-545497c29f67 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:55.903171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697c1f9-7775-4cc7-89cc-545497c29f67 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:55.905453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 649/1306] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:55.912588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58511251-6474-4f53-b376-42de55042dfc None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:55.913118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58511251-6474-4f53-b376-42de55042dfc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:55.913222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58511251-6474-4f53-b376-42de55042dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:55.930660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-58511251-6474-4f53-b376-42de55042dfc None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:55.931912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-58511251-6474-4f53-b376-42de55042dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:55.946239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 658/1307] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:49:55.987781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697c1f9-7775-4cc7-89cc-545497c29f67 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:56.002641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697c1f9-7775-4cc7-89cc-545497c29f67 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:56.008214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4cf0f-628a-4ef6-a7b0-81b06756cb1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:56.008845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4cf0f-628a-4ef6-a7b0-81b06756cb1c service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:56.009128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4cf0f-628a-4ef6-a7b0-81b06756cb1c service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:56.009413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4cf0f-628a-4ef6-a7b0-81b06756cb1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:56.018190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4cf0f-628a-4ef6-a7b0-81b06756cb1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:56.019814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4cf0f-628a-4ef6-a7b0-81b06756cb1c service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:56.031159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 650/1308] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:49:58.346268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358527-8066-4787-b68c-259a8e4c7968 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:58.346817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358527-8066-4787-b68c-259a8e4c7968 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:58.346817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93358527-8066-4787-b68c-259a8e4c7968 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:58.353363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 659/1309] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:49:58 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:49:58.354964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b109a1-b84a-4d1a-8e78-ecb9572d6cdb None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:58.355366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b109a1-b84a-4d1a-8e78-ecb9572d6cdb None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:58.355547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b109a1-b84a-4d1a-8e78-ecb9572d6cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:58.374681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c6b109a1-b84a-4d1a-8e78-ecb9572d6cdb None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:49:58.375926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c6b109a1-b84a-4d1a-8e78-ecb9572d6cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:49:58.391658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 651/1310] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:49:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:49:58.430585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358527-8066-4787-b68c-259a8e4c7968 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:49:58.444870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93358527-8066-4787-b68c-259a8e4c7968 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:49:58.453128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829369a-fd26-430a-a443-48af4154df0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:49:58.453992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829369a-fd26-430a-a443-48af4154df0c service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:49:58.454541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829369a-fd26-430a-a443-48af4154df0c service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:49:58.454994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829369a-fd26-430a-a443-48af4154df0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:49:58.464036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829369a-fd26-430a-a443-48af4154df0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:49:58.465786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829369a-fd26-430a-a443-48af4154df0c service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:49:58.475811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 660/1311] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:49:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:11.270332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836236-1e7d-4634-bc56-e5b6a5820768 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:11.270869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836236-1e7d-4634-bc56-e5b6a5820768 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:11.270869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36836236-1e7d-4634-bc56-e5b6a5820768 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:11.272705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 652/1312] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:11.279180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b2be-4cb4-487d-ab6a-eda9df60b80e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:11.279592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b2be-4cb4-487d-ab6a-eda9df60b80e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:11.279766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831b2be-4cb4-487d-ab6a-eda9df60b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:11.299864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6831b2be-4cb4-487d-ab6a-eda9df60b80e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:11.301050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6831b2be-4cb4-487d-ab6a-eda9df60b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:11.308790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 661/1313] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:11.332545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36836236-1e7d-4634-bc56-e5b6a5820768 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:11.345040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36836236-1e7d-4634-bc56-e5b6a5820768 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:11.349381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cced8-da22-46dc-b97e-615365e42971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:11.350016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cced8-da22-46dc-b97e-615365e42971 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:11.350296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cced8-da22-46dc-b97e-615365e42971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:11.350567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cced8-da22-46dc-b97e-615365e42971 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:11.351301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cced8-da22-46dc-b97e-615365e42971 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:11.353171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cced8-da22-46dc-b97e-615365e42971 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:11.371854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 653/1314] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:50:11 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:50:13.671568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f376a-4096-4601-888f-d511d743f642 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:13.672142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f376a-4096-4601-888f-d511d743f642 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:13.672142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f376a-4096-4601-888f-d511d743f642 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:13.673956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 662/1315] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:13.680239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:13.680652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:13.680790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:13.699229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:13.700496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:13.708165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 654/1316] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:13.731085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f376a-4096-4601-888f-d511d743f642 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:13.743067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f376a-4096-4601-888f-d511d743f642 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:13.748036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:13.748977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:13.749267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:13.749543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] PATH_INFO: `/v3/projects/37b6065a0d2b4f05acf45b9adc524134` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:13.759915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] RBAC: Authorizing `identity:get_project(project_id=37b6065a0d2b4f05acf45b9adc524134)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:13.762588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:13.764295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 663/1317] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:13 2021] GET /identity/v3/projects/37b6065a0d2b4f05acf45b9adc524134 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:13.771051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:13.780059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226e031-7a7d-4241-97e5-61c48624c7d1 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:13.784703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:13.785341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:13.785620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:13.785892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:13.786913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] RBAC: Adding query filter params (scope.project.id=37b6065a0d2b4f05acf45b9adc524134) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:13.787225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:13.789111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f522307-cf68-475d-826f-93a82c8c6eb5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:13.795452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 655/1318] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:13 2021] GET /identity/v3/role_assignments?scope.project.id=37b6065a0d2b4f05acf45b9adc524134 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:13.801527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:13.811314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c621f6-1d3e-4d8c-9faf-3390fb97c857 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:13.815741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941f5b9-ff8f-4461-b50d-dd3080cfa81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:13.816589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941f5b9-ff8f-4461-b50d-dd3080cfa81a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:13.816868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941f5b9-ff8f-4461-b50d-dd3080cfa81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:13.817141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941f5b9-ff8f-4461-b50d-dd3080cfa81a admin admin] PATH_INFO: `/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:13.830607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941f5b9-ff8f-4461-b50d-dd3080cfa81a admin admin] RBAC: Authorizing `identity:get_user(user_id=d8b3ccbc13cb4dce9e8e37244f82d0f3)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:13.832980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941f5b9-ff8f-4461-b50d-dd3080cfa81a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:13.834745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 664/1319] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:13 2021] GET /identity/v3/users/d8b3ccbc13cb4dce9e8e37244f82d0f3 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:16.092613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb796d7-70cd-4a31-bf8b-25ac306f355b None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:16.093171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb796d7-70cd-4a31-bf8b-25ac306f355b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:16.093267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb796d7-70cd-4a31-bf8b-25ac306f355b None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:16.095037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 656/1320] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:16.101244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:16.101692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:16.101808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:16.118969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:16.120169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:16.128249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 665/1321] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:16.151301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb796d7-70cd-4a31-bf8b-25ac306f355b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:16.163343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb796d7-70cd-4a31-bf8b-25ac306f355b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:16.168314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:16.169146 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:16.169425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:16.169698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] PATH_INFO: `/v3/projects/544e6da2df684d0e97130d11c4954cc8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:16.180386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] RBAC: Authorizing `identity:get_project(project_id=544e6da2df684d0e97130d11c4954cc8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:16.182421 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:16.184759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 657/1322] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:16 2021] GET /identity/v3/projects/544e6da2df684d0e97130d11c4954cc8 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:16.191170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:16.199856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba03fa-a490-4ecf-86b2-3112fee4eb2c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:16.204314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:16.204941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:16.205221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:16.205496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:16.206265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] RBAC: Adding query filter params (scope.project.id=544e6da2df684d0e97130d11c4954cc8) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:16.206573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:16.208427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:16.216397 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 666/1323] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:16 2021] GET /identity/v3/role_assignments?scope.project.id=544e6da2df684d0e97130d11c4954cc8 => generated 877 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:16.222745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:16.232694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea790a-436c-40e3-9396-3b18d8e9a052 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:16.237125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941959-3966-4d91-b135-b29aebd2e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:16.237969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941959-3966-4d91-b135-b29aebd2e551 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:16.238254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941959-3966-4d91-b135-b29aebd2e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:16.238533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941959-3966-4d91-b135-b29aebd2e551 admin admin] PATH_INFO: `/v3/users/a2fbf324c88b47c6aef85d937f1c592a` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:16.252073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38941959-3966-4d91-b135-b29aebd2e551 admin admin] RBAC: Authorizing `identity:get_user(user_id=a2fbf324c88b47c6aef85d937f1c592a)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:16.254204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38941959-3966-4d91-b135-b29aebd2e551 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:16.255801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 658/1324] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:16 2021] GET /identity/v3/users/a2fbf324c88b47c6aef85d937f1c592a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:16.261818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:16.271149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a29ef-dbd6-4e0a-aa6a-fd2a73498524 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:16.275578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77548200-f1c8-4160-84f2-80ede2018e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:16.276443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77548200-f1c8-4160-84f2-80ede2018e94 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:16.276733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77548200-f1c8-4160-84f2-80ede2018e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:16.277011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77548200-f1c8-4160-84f2-80ede2018e94 admin admin] PATH_INFO: `/v3/users/8cba3e20e5e6412a9df321ff96021ce0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:16.290114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77548200-f1c8-4160-84f2-80ede2018e94 admin admin] RBAC: Authorizing `identity:get_user(user_id=8cba3e20e5e6412a9df321ff96021ce0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:16.292839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77548200-f1c8-4160-84f2-80ede2018e94 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:16.294428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 667/1325] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:16 2021] GET /identity/v3/users/8cba3e20e5e6412a9df321ff96021ce0 => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:18.572466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5697e-a9f8-48b9-8ed6-668f7a03f000 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:18.572871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5697e-a9f8-48b9-8ed6-668f7a03f000 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:18.573019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5697e-a9f8-48b9-8ed6-668f7a03f000 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:18.575317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 659/1326] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:18.581314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:18.581740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:18.581854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:18.599297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:18.600516 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:18.608478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 668/1327] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:18.631915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5697e-a9f8-48b9-8ed6-668f7a03f000 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:18.644381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5697e-a9f8-48b9-8ed6-668f7a03f000 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:18.648821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:18.649654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:18.649935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:18.650209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] PATH_INFO: `/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:18.661103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] RBAC: Authorizing `identity:get_project(project_id=5b4e57e4b88f46b79e1ba71e17c1c216)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:18.663402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:18.665096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 660/1328] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:18 2021] GET /identity/v3/projects/5b4e57e4b88f46b79e1ba71e17c1c216 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:18.671831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:18.680738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792c52-5744-4234-a6ac-d3f71c1695a1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:18.685810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:18.686446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:18.686732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:18.687010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:18.687821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] RBAC: Adding query filter params (scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:18.688138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:18.689964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:18.696480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 669/1329] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:18 2021] GET /identity/v3/role_assignments?scope.project.id=5b4e57e4b88f46b79e1ba71e17c1c216 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:50:18.703064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:18.712528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c4709-48b0-49a4-ace4-36a336ee502d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:18.717003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86623d1b-b88b-43c8-a173-1f6207b7f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:18.717839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623d1b-b88b-43c8-a173-1f6207b7f729 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:18.718119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623d1b-b88b-43c8-a173-1f6207b7f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:18.718392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623d1b-b88b-43c8-a173-1f6207b7f729 admin admin] PATH_INFO: `/v3/users/94381fecb7f9488eba1dfafeca14fab5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:18.731347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86623d1b-b88b-43c8-a173-1f6207b7f729 admin admin] RBAC: Authorizing `identity:get_user(user_id=94381fecb7f9488eba1dfafeca14fab5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:18.733492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86623d1b-b88b-43c8-a173-1f6207b7f729 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:18.735071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 661/1330] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:18 2021] GET /identity/v3/users/94381fecb7f9488eba1dfafeca14fab5 => generated 283 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:18.741599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:18.751683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490955d3-5d2b-49c8-b4f9-67d631f3d3c2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:18.756280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02363260-2c29-459b-98e7-1477bc008759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:18.757176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363260-2c29-459b-98e7-1477bc008759 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:18.757468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363260-2c29-459b-98e7-1477bc008759 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:18.757754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02363260-2c29-459b-98e7-1477bc008759 admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:18.759053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02363260-2c29-459b-98e7-1477bc008759 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:18.761501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02363260-2c29-459b-98e7-1477bc008759 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:18.763091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 670/1331] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:18 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:21.053593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fbeb6-0b32-479f-8988-97b5806b616e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:21.054123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fbeb6-0b32-479f-8988-97b5806b616e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:21.054216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fbeb6-0b32-479f-8988-97b5806b616e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:21.055952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 662/1332] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:21.061725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:21.062144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:21.062310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:21.079447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:21.080651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:21.088175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 671/1333] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:21.112581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fbeb6-0b32-479f-8988-97b5806b616e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:21.124813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fbeb6-0b32-479f-8988-97b5806b616e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:21.129308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:21.130171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:21.130449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:21.130725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] PATH_INFO: `/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:21.141089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] RBAC: Authorizing `identity:get_project(project_id=7c1c32f041464e76b60eaf53f01b9ee8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:21.143106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:21.144773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 663/1334] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:21 2021] GET /identity/v3/projects/7c1c32f041464e76b60eaf53f01b9ee8 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:21.151051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:21.160199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa0982-31e4-4986-bf7c-c6f964f2612b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:21.164902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:21.165531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:21.165810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:21.166085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:21.166862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] RBAC: Adding query filter params (scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:21.167761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:21.169568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:21.176005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 672/1335] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:21 2021] GET /identity/v3/role_assignments?scope.project.id=7c1c32f041464e76b60eaf53f01b9ee8 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:50:21.182063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:21.191345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296954b-2a7e-410e-8b6e-2a489906f48d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:21.195819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c91b3-0ca0-4c8a-bbb3-397dc3769ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:21.196643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c91b3-0ca0-4c8a-bbb3-397dc3769ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:21.196921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c91b3-0ca0-4c8a-bbb3-397dc3769ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:21.197191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c91b3-0ca0-4c8a-bbb3-397dc3769ce3 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:21.210138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c91b3-0ca0-4c8a-bbb3-397dc3769ce3 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:21.212726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c91b3-0ca0-4c8a-bbb3-397dc3769ce3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:21.214827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 664/1336] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:21 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:50:21.221331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:21.231343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d33da-ccc5-4947-baf8-770c180fd4c8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:21.235864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fe6e0-cad9-482b-a3bf-a5cbf64e76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:21.236704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fe6e0-cad9-482b-a3bf-a5cbf64e76bc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:21.236989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fe6e0-cad9-482b-a3bf-a5cbf64e76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:21.237269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fe6e0-cad9-482b-a3bf-a5cbf64e76bc admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:21.238459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fe6e0-cad9-482b-a3bf-a5cbf64e76bc admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:21.240264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fe6e0-cad9-482b-a3bf-a5cbf64e76bc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:21.241814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 673/1337] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:21 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:23.550037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2156fe-a662-446b-9de4-62d899d00776 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:23.550579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2156fe-a662-446b-9de4-62d899d00776 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:23.550579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2156fe-a662-446b-9de4-62d899d00776 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:23.552485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 665/1338] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:23.558583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:23.558971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:23.559163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:23.576844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:23.578022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:23.585536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 674/1339] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:23.609117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2156fe-a662-446b-9de4-62d899d00776 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:23.621042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2156fe-a662-446b-9de4-62d899d00776 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:23.625343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:23.626170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:23.626447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:23.626714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] PATH_INFO: `/v3/projects/98146912a4594b47b6620b2e1ee83d93` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:23.627905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] RBAC: Authorizing `identity:get_project(project_id=98146912a4594b47b6620b2e1ee83d93)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:23.629693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:23.631302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 666/1340] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:23 2021] GET /identity/v3/projects/98146912a4594b47b6620b2e1ee83d93 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:23.638255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:23.646923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960057c-47a0-42f8-a438-342e7eca8999 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:23.652255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:23.652873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:23.653181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:23.653457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:23.654260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] RBAC: Adding query filter params (scope.project.id=98146912a4594b47b6620b2e1ee83d93) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:23.654561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:23.656419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5cd5ab-4240-42cb-87ae-84f4503d1db2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:23.662241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 675/1341] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:23 2021] GET /identity/v3/role_assignments?scope.project.id=98146912a4594b47b6620b2e1ee83d93 => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:23.668536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:23.677909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3999c270-6346-4c58-bf5e-fafe51bd733c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:23.682414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79771-b33e-466c-8958-c8b5561f1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:23.683547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79771-b33e-466c-8958-c8b5561f1880 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:23.683881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79771-b33e-466c-8958-c8b5561f1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:23.684164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79771-b33e-466c-8958-c8b5561f1880 admin admin] PATH_INFO: `/v3/users/dce917494d344377a020b14e93b0e3e7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:23.685349 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79771-b33e-466c-8958-c8b5561f1880 admin admin] RBAC: Authorizing `identity:get_user(user_id=dce917494d344377a020b14e93b0e3e7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:23.687113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79771-b33e-466c-8958-c8b5561f1880 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:23.688725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 667/1342] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:23 2021] GET /identity/v3/users/dce917494d344377a020b14e93b0e3e7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:25.923975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3bb6-9c2a-40fe-b3c1-556722335dbe None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:25.924493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3bb6-9c2a-40fe-b3c1-556722335dbe None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:25.924612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e3bb6-9c2a-40fe-b3c1-556722335dbe None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:25.926286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 676/1343] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:25.932128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:25.932533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:25.932681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:25.950532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:25.951731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:25.959262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 668/1344] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:25.982803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3bb6-9c2a-40fe-b3c1-556722335dbe None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:25.994632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e3bb6-9c2a-40fe-b3c1-556722335dbe None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:25.998982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:25.999832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:26.000116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:26.000390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] PATH_INFO: `/v3/projects/a8e075c0e5c9471da973df015bf5d36e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:26.011060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] RBAC: Authorizing `identity:get_project(project_id=a8e075c0e5c9471da973df015bf5d36e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:26.013122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:26.014757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 677/1345] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:25 2021] GET /identity/v3/projects/a8e075c0e5c9471da973df015bf5d36e => generated 311 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:26.021208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:26.030650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df20c1-66be-4231-b5da-ed1776072bb5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:26.035138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:26.035803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:26.036092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:26.036624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:26.037400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] RBAC: Adding query filter params (scope.project.id=a8e075c0e5c9471da973df015bf5d36e) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:26.037709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:26.039537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944a149-b3bd-4fd5-bc48-af7bea1d426b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:26.044984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 669/1346] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:26 2021] GET /identity/v3/role_assignments?scope.project.id=a8e075c0e5c9471da973df015bf5d36e => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:50:26.051193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:26.060703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3f4e8-e717-4d0a-bddc-01b58918e832 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:26.065116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be77698-12f5-4d56-b358-d760851ce26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:26.065956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be77698-12f5-4d56-b358-d760851ce26a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:26.066239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be77698-12f5-4d56-b358-d760851ce26a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:26.066515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be77698-12f5-4d56-b358-d760851ce26a admin admin] PATH_INFO: `/v3/users/d680c8d9112f49979ed46f38772b70f5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:26.079883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be77698-12f5-4d56-b358-d760851ce26a admin admin] RBAC: Authorizing `identity:get_user(user_id=d680c8d9112f49979ed46f38772b70f5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:26.081991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be77698-12f5-4d56-b358-d760851ce26a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:26.083563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 678/1347] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:26 2021] GET /identity/v3/users/d680c8d9112f49979ed46f38772b70f5 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:28.400807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8b77-2c4d-43d8-83de-6c3ff8878c51 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:28.401381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8b77-2c4d-43d8-83de-6c3ff8878c51 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:28.401499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db8b77-2c4d-43d8-83de-6c3ff8878c51 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:28.403185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 670/1348] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:28.409180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:28.409578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:28.409760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:28.427318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:28.428548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:28.436734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 679/1349] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:28.459565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8b77-2c4d-43d8-83de-6c3ff8878c51 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:28.472103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db8b77-2c4d-43d8-83de-6c3ff8878c51 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:28.476818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:28.477645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:28.477930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:28.478204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] PATH_INFO: `/v3/projects/b0a79647a31548759709022dbdbab0e0` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:28.489046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] RBAC: Authorizing `identity:get_project(project_id=b0a79647a31548759709022dbdbab0e0)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:28.491082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:28.492762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 671/1350] 10.222.0.41 () {56 vars in 1207 bytes} [Tue Nov 9 04:50:28 2021] GET /identity/v3/projects/b0a79647a31548759709022dbdbab0e0 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:28.498958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:28.507737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ed342-8a2d-4309-80c0-774e8f61967e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:28.512232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:28.512866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:28.513155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:28.513435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:28.514217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] RBAC: Adding query filter params (scope.project.id=b0a79647a31548759709022dbdbab0e0) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:50:28.514529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:28.516387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08deb5a-f307-4aa5-85db-118ea7a97f93 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:28.521625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 680/1351] 10.222.0.41 () {56 vars in 1231 bytes} [Tue Nov 9 04:50:28 2021] GET /identity/v3/role_assignments?scope.project.id=b0a79647a31548759709022dbdbab0e0 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:28.528018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:28.537612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f985a0-df5b-4745-9baa-fab893c82e6b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:28.542700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df227-cf23-4985-9516-184878a1eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:28.543523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df227-cf23-4985-9516-184878a1eb12 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:28.543829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df227-cf23-4985-9516-184878a1eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:28.544102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df227-cf23-4985-9516-184878a1eb12 admin admin] PATH_INFO: `/v3/users/d6e04acab92947cbb4ee9ad021c576a2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:28.545284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df227-cf23-4985-9516-184878a1eb12 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6e04acab92947cbb4ee9ad021c576a2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:28.547357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df227-cf23-4985-9516-184878a1eb12 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:28.548916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 672/1352] 10.222.0.41 () {56 vars in 1198 bytes} [Tue Nov 9 04:50:28 2021] GET /identity/v3/users/d6e04acab92947cbb4ee9ad021c576a2 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:50:33.714094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2e4a-c74e-42d6-b090-c3a4ace624a0 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:33.714669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2e4a-c74e-42d6-b090-c3a4ace624a0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:33.714669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a2e4a-c74e-42d6-b090-c3a4ace624a0 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:33.716493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 681/1353] 10.222.0.41 () {54 vars in 918 bytes} [Tue Nov 9 04:50:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:33.722482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da6cd3-f7ef-4fb6-91a8-4ebdc3857a5c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:33.722937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da6cd3-f7ef-4fb6-91a8-4ebdc3857a5c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:33.723082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da6cd3-f7ef-4fb6-91a8-4ebdc3857a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:33.741813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e7da6cd3-f7ef-4fb6-91a8-4ebdc3857a5c None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:33.743019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e7da6cd3-f7ef-4fb6-91a8-4ebdc3857a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:33.751470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 673/1354] 10.222.0.41 () {58 vars in 1015 bytes} [Tue Nov 9 04:50:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:50:33.771511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dd282-3bd2-4e9c-896c-065931b1451c None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:33.771830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dd282-3bd2-4e9c-896c-065931b1451c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:33.772120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071dd282-3bd2-4e9c-896c-065931b1451c None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:33.773921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 682/1355] 10.222.0.41 () {54 vars in 918 bytes} [Tue Nov 9 04:50:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:33.779839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5bf8-5ffa-45c2-ba6f-19b2c59c30a4 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:33.780130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5bf8-5ffa-45c2-ba6f-19b2c59c30a4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:33.780410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835c5bf8-5ffa-45c2-ba6f-19b2c59c30a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:33.798999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-835c5bf8-5ffa-45c2-ba6f-19b2c59c30a4 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:33.800216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-835c5bf8-5ffa-45c2-ba6f-19b2c59c30a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:33.809385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 674/1356] 10.222.0.41 () {58 vars in 1015 bytes} [Tue Nov 9 04:50:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:36.664873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34967-c1d5-4f91-b350-ce143b13a1ab None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:36.665385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34967-c1d5-4f91-b350-ce143b13a1ab None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:36.665498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b34967-c1d5-4f91-b350-ce143b13a1ab None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:36.667209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 683/1357] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:36.673096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d387-ba6f-47c8-a715-4b12d8ca5b12 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:36.673525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d387-ba6f-47c8-a715-4b12d8ca5b12 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:36.673658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6d387-ba6f-47c8-a715-4b12d8ca5b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:36.691373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b8f6d387-ba6f-47c8-a715-4b12d8ca5b12 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:36.692587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b8f6d387-ba6f-47c8-a715-4b12d8ca5b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:36.700782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 675/1358] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:36.742819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34967-c1d5-4f91-b350-ce143b13a1ab None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:36.757246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b34967-c1d5-4f91-b350-ce143b13a1ab None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:36.763194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9b953-f7ba-4561-9731-93fbe1cadd1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:36.763856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b953-f7ba-4561-9731-93fbe1cadd1d service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:36.764142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b953-f7ba-4561-9731-93fbe1cadd1d service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:36.764425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9b953-f7ba-4561-9731-93fbe1cadd1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:36.772294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9b953-f7ba-4561-9731-93fbe1cadd1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:36.773861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9b953-f7ba-4561-9731-93fbe1cadd1d service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:36.782867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 684/1359] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:38.273805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed074d-208d-4165-b12f-ab1e0d4ef1b3 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:38.274374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed074d-208d-4165-b12f-ab1e0d4ef1b3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:38.274374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed074d-208d-4165-b12f-ab1e0d4ef1b3 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:38.276687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 676/1360] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:38.282160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e1ec7-5cf0-475f-9055-7edcf85c22ae None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:38.282559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e1ec7-5cf0-475f-9055-7edcf85c22ae None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:38.282722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e1ec7-5cf0-475f-9055-7edcf85c22ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:38.300709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b43e1ec7-5cf0-475f-9055-7edcf85c22ae None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:38.301885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b43e1ec7-5cf0-475f-9055-7edcf85c22ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:38.309517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 685/1361] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:38.459217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed074d-208d-4165-b12f-ab1e0d4ef1b3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:38.473652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed074d-208d-4165-b12f-ab1e0d4ef1b3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:38.478991 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306d2345-c6b8-4c3e-b698-ba826e4263d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:38.480210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d2345-c6b8-4c3e-b698-ba826e4263d0 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:38.480500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d2345-c6b8-4c3e-b698-ba826e4263d0 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:38.480780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306d2345-c6b8-4c3e-b698-ba826e4263d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:38.488642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d2345-c6b8-4c3e-b698-ba826e4263d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:38.490232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306d2345-c6b8-4c3e-b698-ba826e4263d0 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:38.499531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 677/1362] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:39.954222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8795-b86f-43fc-a635-e37f7a59e6f9 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:39.954772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8795-b86f-43fc-a635-e37f7a59e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:39.954876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf8795-b86f-43fc-a635-e37f7a59e6f9 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:39.956703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 686/1363] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:39.962022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719888-2a56-459a-a02d-e52449a36de1 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:39.962415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719888-2a56-459a-a02d-e52449a36de1 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:39.962591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8719888-2a56-459a-a02d-e52449a36de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:39.980967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b8719888-2a56-459a-a02d-e52449a36de1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:39.982159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b8719888-2a56-459a-a02d-e52449a36de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:39.989818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 678/1364] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:40.140896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8795-b86f-43fc-a635-e37f7a59e6f9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:40.155463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf8795-b86f-43fc-a635-e37f7a59e6f9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:40.160729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76836d2b-3387-40ad-b859-d37239cb9f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:40.161354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836d2b-3387-40ad-b859-d37239cb9f11 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:40.161891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836d2b-3387-40ad-b859-d37239cb9f11 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:40.162169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76836d2b-3387-40ad-b859-d37239cb9f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:40.169810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836d2b-3387-40ad-b859-d37239cb9f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:40.171401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76836d2b-3387-40ad-b859-d37239cb9f11 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:40.180504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 687/1365] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:41.625256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4f56-7c22-4d4a-8c7f-94f26405d203 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:41.625749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4f56-7c22-4d4a-8c7f-94f26405d203 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:41.625854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d4f56-7c22-4d4a-8c7f-94f26405d203 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:41.627567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 679/1366] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:41.633277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da07b-e52f-4500-9927-e26362943385 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:41.633703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da07b-e52f-4500-9927-e26362943385 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:41.633840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7da07b-e52f-4500-9927-e26362943385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:41.652034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8d7da07b-e52f-4500-9927-e26362943385 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:41.653222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8d7da07b-e52f-4500-9927-e26362943385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:41.661012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 688/1367] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:41.811561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4f56-7c22-4d4a-8c7f-94f26405d203 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:41.826150 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d4f56-7c22-4d4a-8c7f-94f26405d203 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:41.831343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d6a94-e3c9-4559-a534-b33fd995a040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:41.832007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d6a94-e3c9-4559-a534-b33fd995a040 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:41.832292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d6a94-e3c9-4559-a534-b33fd995a040 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:41.832568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d6a94-e3c9-4559-a534-b33fd995a040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:41.841155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d6a94-e3c9-4559-a534-b33fd995a040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:41.842747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d6a94-e3c9-4559-a534-b33fd995a040 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:41.851799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 680/1368] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:43.289244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c390-bc1a-4939-9698-6b3985a63242 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:43.289807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c390-bc1a-4939-9698-6b3985a63242 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:43.289807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652c390-bc1a-4939-9698-6b3985a63242 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:43.292148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 689/1369] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:43.297621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d54d-b856-420c-8c48-184734a8a033 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:43.298040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d54d-b856-420c-8c48-184734a8a033 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:43.298173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d54d-b856-420c-8c48-184734a8a033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:43.318044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0fd5d54d-b856-420c-8c48-184734a8a033 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:43.319236 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0fd5d54d-b856-420c-8c48-184734a8a033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:43.326820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 681/1370] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:43.477198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652c390-bc1a-4939-9698-6b3985a63242 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:43.491645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652c390-bc1a-4939-9698-6b3985a63242 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:43.496939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5329d-34ac-4c3d-9bff-040a64d91d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:43.497565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5329d-34ac-4c3d-9bff-040a64d91d43 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:43.497847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5329d-34ac-4c3d-9bff-040a64d91d43 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:43.498123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5329d-34ac-4c3d-9bff-040a64d91d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:43.506237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5329d-34ac-4c3d-9bff-040a64d91d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:43.507882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5329d-34ac-4c3d-9bff-040a64d91d43 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:43.516893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 690/1371] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:44.919527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997952-9bd8-4bd5-86ed-98ab8c0f4735 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:44.920119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997952-9bd8-4bd5-86ed-98ab8c0f4735 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:44.920119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46997952-9bd8-4bd5-86ed-98ab8c0f4735 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:44.921904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 682/1372] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:44.927284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb53b-8637-4a3e-9d49-67a34534700e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:44.927715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb53b-8637-4a3e-9d49-67a34534700e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:44.927857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875bb53b-8637-4a3e-9d49-67a34534700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:44.945462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-875bb53b-8637-4a3e-9d49-67a34534700e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:44.946643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-875bb53b-8637-4a3e-9d49-67a34534700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:44.954753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 691/1373] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:45.103104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997952-9bd8-4bd5-86ed-98ab8c0f4735 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:45.116998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46997952-9bd8-4bd5-86ed-98ab8c0f4735 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:45.122740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c9676-a37e-420d-9b4c-b7bf65e5831a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:45.123368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c9676-a37e-420d-9b4c-b7bf65e5831a service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:45.123677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c9676-a37e-420d-9b4c-b7bf65e5831a service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:45.123956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c9676-a37e-420d-9b4c-b7bf65e5831a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:45.131732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c9676-a37e-420d-9b4c-b7bf65e5831a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:45.133317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c9676-a37e-420d-9b4c-b7bf65e5831a service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:45.142783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 683/1374] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:46.542794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cb7d-0dab-445a-839d-cbf2a176827e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:46.543702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cb7d-0dab-445a-839d-cbf2a176827e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:46.543702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cb7d-0dab-445a-839d-cbf2a176827e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:46.545187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 692/1375] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:46.550799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adb1dd-992e-4776-b575-e804c42f2682 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:46.551258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adb1dd-992e-4776-b575-e804c42f2682 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:46.551410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adb1dd-992e-4776-b575-e804c42f2682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:46.569264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-46adb1dd-992e-4776-b575-e804c42f2682 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:46.570470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-46adb1dd-992e-4776-b575-e804c42f2682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:46.578326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 684/1376] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:46.737877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cb7d-0dab-445a-839d-cbf2a176827e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:46.752021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cb7d-0dab-445a-839d-cbf2a176827e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:46.757382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efdfc3-0a17-4ffc-bead-82f361db337b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:46.758014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efdfc3-0a17-4ffc-bead-82f361db337b service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:46.758296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efdfc3-0a17-4ffc-bead-82f361db337b service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:46.758572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efdfc3-0a17-4ffc-bead-82f361db337b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:46.767136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efdfc3-0a17-4ffc-bead-82f361db337b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:46.768801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efdfc3-0a17-4ffc-bead-82f361db337b service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:46.778800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 693/1377] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:48.171956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301f1bc-3b53-4207-8474-606dd7406616 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:48.172487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301f1bc-3b53-4207-8474-606dd7406616 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:48.172577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301f1bc-3b53-4207-8474-606dd7406616 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:48.174296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 685/1378] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:48.179865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6d6c-caee-4780-afe2-7db8c201c333 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:48.180284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6d6c-caee-4780-afe2-7db8c201c333 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:48.180432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f6d6c-caee-4780-afe2-7db8c201c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:48.199010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-709f6d6c-caee-4780-afe2-7db8c201c333 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:48.200234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-709f6d6c-caee-4780-afe2-7db8c201c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:48.207807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 694/1379] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:48.356318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301f1bc-3b53-4207-8474-606dd7406616 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:48.371224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301f1bc-3b53-4207-8474-606dd7406616 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:48.376714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162ad6a-c18a-4690-8aec-9ecff785d978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:48.377353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ad6a-c18a-4690-8aec-9ecff785d978 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:48.377636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ad6a-c18a-4690-8aec-9ecff785d978 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:48.377913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ad6a-c18a-4690-8aec-9ecff785d978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:48.385955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162ad6a-c18a-4690-8aec-9ecff785d978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:48.387543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162ad6a-c18a-4690-8aec-9ecff785d978 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:48.396982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 686/1380] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:49.787986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0e39f-c2b7-45a6-a65c-73c55fb70516 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:49.788556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0e39f-c2b7-45a6-a65c-73c55fb70516 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:49.788556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0e39f-c2b7-45a6-a65c-73c55fb70516 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:49.790306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 695/1381] 10.222.0.41 () {54 vars in 911 bytes} [Tue Nov 9 04:50:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:49.796251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64240-7123-4c39-a629-81613a7bec95 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:49.796666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64240-7123-4c39-a629-81613a7bec95 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:49.796816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb64240-7123-4c39-a629-81613a7bec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:49.814130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6eb64240-7123-4c39-a629-81613a7bec95 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:49.815306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6eb64240-7123-4c39-a629-81613a7bec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:49.823542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 687/1382] 10.222.0.41 () {58 vars in 1008 bytes} [Tue Nov 9 04:50:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:49.974613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0e39f-c2b7-45a6-a65c-73c55fb70516 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:49.989078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0e39f-c2b7-45a6-a65c-73c55fb70516 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:49.994369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702984c-0a8f-4aca-baab-af79faf50ec6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:49.995606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702984c-0a8f-4aca-baab-af79faf50ec6 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:49.995932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702984c-0a8f-4aca-baab-af79faf50ec6 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:49.996212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702984c-0a8f-4aca-baab-af79faf50ec6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:50.004124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702984c-0a8f-4aca-baab-af79faf50ec6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:50.005701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702984c-0a8f-4aca-baab-af79faf50ec6 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:50.015196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 696/1383] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:52.132368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd33f9-faf4-47d8-b286-6dba4294cc4d None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:52.132898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd33f9-faf4-47d8-b286-6dba4294cc4d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:52.132898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd33f9-faf4-47d8-b286-6dba4294cc4d None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:52.134673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 688/1384] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:52.140631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaeeb0-00e3-49ee-8846-9ee8ef50fa17 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:52.141104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaeeb0-00e3-49ee-8846-9ee8ef50fa17 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:52.141204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaeeb0-00e3-49ee-8846-9ee8ef50fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:52.158330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-54eaeeb0-00e3-49ee-8846-9ee8ef50fa17 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:52.159493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-54eaeeb0-00e3-49ee-8846-9ee8ef50fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:52.167851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 697/1385] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:52.206821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd33f9-faf4-47d8-b286-6dba4294cc4d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:52.208625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fffd33f9-faf4-47d8-b286-6dba4294cc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:52.224851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd33f9-faf4-47d8-b286-6dba4294cc4d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:52.229485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091a806-c058-42cc-b8e9-b8472ea6dfbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:52.230125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a806-c058-42cc-b8e9-b8472ea6dfbc service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:52.230406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a806-c058-42cc-b8e9-b8472ea6dfbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:52.230683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091a806-c058-42cc-b8e9-b8472ea6dfbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:52.239487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091a806-c058-42cc-b8e9-b8472ea6dfbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:52.240938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091a806-c058-42cc-b8e9-b8472ea6dfbc service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:52.250461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 689/1386] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:54.675399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0955e8-4d81-4dd5-a523-ff80285b3d66 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:54.675978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0955e8-4d81-4dd5-a523-ff80285b3d66 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:54.675978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0955e8-4d81-4dd5-a523-ff80285b3d66 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:54.677774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 698/1387] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:54.684206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3b87c-c4a2-4008-89b0-033ab7b623e7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:54.684610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3b87c-c4a2-4008-89b0-033ab7b623e7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:54.684768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3b87c-c4a2-4008-89b0-033ab7b623e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:54.701990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-03d3b87c-c4a2-4008-89b0-033ab7b623e7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:54.703171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-03d3b87c-c4a2-4008-89b0-033ab7b623e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:54.710837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 690/1388] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:50:54.750966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0955e8-4d81-4dd5-a523-ff80285b3d66 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:54.761210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0955e8-4d81-4dd5-a523-ff80285b3d66 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:54.764646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83201317-ed76-46b0-a5a0-30f0599da7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:54.765272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201317-ed76-46b0-a5a0-30f0599da7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:54.765562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201317-ed76-46b0-a5a0-30f0599da7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:54.765838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83201317-ed76-46b0-a5a0-30f0599da7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:54.774830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201317-ed76-46b0-a5a0-30f0599da7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:54.776880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83201317-ed76-46b0-a5a0-30f0599da7b5 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:54.786027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 699/1389] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:50:57.298711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac789b7-4acb-44b1-bc1e-dd92630406bc None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:57.299357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac789b7-4acb-44b1-bc1e-dd92630406bc None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:57.299357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac789b7-4acb-44b1-bc1e-dd92630406bc None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:57.301073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 691/1390] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:57.307231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2c07-441b-4889-b2c0-a04d9ef14d09 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:57.307684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2c07-441b-4889-b2c0-a04d9ef14d09 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:57.307831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e2c07-441b-4889-b2c0-a04d9ef14d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:57.325507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-569e2c07-441b-4889-b2c0-a04d9ef14d09 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:57.326725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-569e2c07-441b-4889-b2c0-a04d9ef14d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:57.334402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 700/1391] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:57.373933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac789b7-4acb-44b1-bc1e-dd92630406bc None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:57.384211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac789b7-4acb-44b1-bc1e-dd92630406bc None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:57.388188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b18084-16f6-48fa-9410-b4292144865c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:57.388810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18084-16f6-48fa-9410-b4292144865c service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:57.389088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18084-16f6-48fa-9410-b4292144865c service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:57.389357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b18084-16f6-48fa-9410-b4292144865c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:57.397899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b18084-16f6-48fa-9410-b4292144865c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:57.399312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b18084-16f6-48fa-9410-b4292144865c service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:57.408754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 692/1392] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:50:59.758733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614b8b5-a7c8-4163-bb96-c9cf1db80b85 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:59.759304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614b8b5-a7c8-4163-bb96-c9cf1db80b85 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:59.759304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614b8b5-a7c8-4163-bb96-c9cf1db80b85 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:59.761669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 701/1393] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:50:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:50:59.767766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26157-bba2-49b8-b0f0-20450c8f2b24 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:59.768203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26157-bba2-49b8-b0f0-20450c8f2b24 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:59.768334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe26157-bba2-49b8-b0f0-20450c8f2b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:59.786798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ebe26157-bba2-49b8-b0f0-20450c8f2b24 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:50:59.788000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ebe26157-bba2-49b8-b0f0-20450c8f2b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:50:59.795596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 693/1394] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:50:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:50:59.835198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614b8b5-a7c8-4163-bb96-c9cf1db80b85 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:50:59.846190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614b8b5-a7c8-4163-bb96-c9cf1db80b85 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:50:59.849664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b5993-f33d-453f-a390-460b9f9c3ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:50:59.850297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5993-f33d-453f-a390-460b9f9c3ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:50:59.850581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5993-f33d-453f-a390-460b9f9c3ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:50:59.850861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b5993-f33d-453f-a390-460b9f9c3ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:50:59.859435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5993-f33d-453f-a390-460b9f9c3ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:50:59.860891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b5993-f33d-453f-a390-460b9f9c3ad4 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:50:59.869880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 702/1395] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:50:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:02.252827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a80b-9beb-4540-a77e-de4c49f4d93e None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:02.253393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a80b-9beb-4540-a77e-de4c49f4d93e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:02.253393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1a80b-9beb-4540-a77e-de4c49f4d93e None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:02.255152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 694/1396] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:02.261053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c3d1-b467-4fb7-a555-824f4e4a5fad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:02.261511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c3d1-b467-4fb7-a555-824f4e4a5fad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:02.261647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91c3d1-b467-4fb7-a555-824f4e4a5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:02.280077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0c91c3d1-b467-4fb7-a555-824f4e4a5fad None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:02.281248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0c91c3d1-b467-4fb7-a555-824f4e4a5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:02.289062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 703/1397] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:02.328823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1a80b-9beb-4540-a77e-de4c49f4d93e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:02.339549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1a80b-9beb-4540-a77e-de4c49f4d93e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:02.343227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceb544-ca22-4eaa-a889-d12318b90f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:02.343887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb544-ca22-4eaa-a889-d12318b90f03 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:02.344168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb544-ca22-4eaa-a889-d12318b90f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:02.344441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceb544-ca22-4eaa-a889-d12318b90f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:02.353086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb544-ca22-4eaa-a889-d12318b90f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:02.355111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceb544-ca22-4eaa-a889-d12318b90f03 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:02.364018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 695/1398] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:04.734680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316398-c881-4715-b4de-b66e3766cee2 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:04.735237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316398-c881-4715-b4de-b66e3766cee2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:04.735237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f316398-c881-4715-b4de-b66e3766cee2 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:04.737045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 704/1399] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:04.742804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708db2-b11b-405d-b0ca-291299afa3c3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:04.743245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708db2-b11b-405d-b0ca-291299afa3c3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:04.743357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f708db2-b11b-405d-b0ca-291299afa3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:04.760697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1f708db2-b11b-405d-b0ca-291299afa3c3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:04.761872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1f708db2-b11b-405d-b0ca-291299afa3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:04.769436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 696/1400] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:04.808858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316398-c881-4715-b4de-b66e3766cee2 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:04.819339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f316398-c881-4715-b4de-b66e3766cee2 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:04.823256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7daba7-00ef-4834-832b-48b72d73b4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:04.823949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daba7-00ef-4834-832b-48b72d73b4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:04.824232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daba7-00ef-4834-832b-48b72d73b4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:04.824507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7daba7-00ef-4834-832b-48b72d73b4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:04.833129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7daba7-00ef-4834-832b-48b72d73b4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:04.834548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7daba7-00ef-4834-832b-48b72d73b4c2 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:04.844031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 705/1401] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:07.102614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1440-791e-471c-a034-e29e7eed8038 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:07.103174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1440-791e-471c-a034-e29e7eed8038 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:07.103174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f1440-791e-471c-a034-e29e7eed8038 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:07.105001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 697/1402] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:07.110854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94220a-e161-4206-a657-5d04bedcf427 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:07.111298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94220a-e161-4206-a657-5d04bedcf427 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:07.111448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94220a-e161-4206-a657-5d04bedcf427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:07.128980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3c94220a-e161-4206-a657-5d04bedcf427 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:07.130178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3c94220a-e161-4206-a657-5d04bedcf427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:07.142894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 706/1403] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:07.181926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1440-791e-471c-a034-e29e7eed8038 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:07.192511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f1440-791e-471c-a034-e29e7eed8038 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:07.195998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87217cd7-0bca-4d0c-a5b1-e21528012f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:07.196631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87217cd7-0bca-4d0c-a5b1-e21528012f48 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:07.196911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87217cd7-0bca-4d0c-a5b1-e21528012f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:07.197182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87217cd7-0bca-4d0c-a5b1-e21528012f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:07.206253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87217cd7-0bca-4d0c-a5b1-e21528012f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:07.207739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87217cd7-0bca-4d0c-a5b1-e21528012f48 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:07.217786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 698/1404] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:09.477486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00fec0-7363-4432-b0f0-56522b6a8d10 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:09.478067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00fec0-7363-4432-b0f0-56522b6a8d10 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:09.478067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c00fec0-7363-4432-b0f0-56522b6a8d10 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:09.479876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 707/1405] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:09.485701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c2698-573e-4ee0-8824-17a47776f763 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:09.486123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c2698-573e-4ee0-8824-17a47776f763 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:09.486266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c2698-573e-4ee0-8824-17a47776f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:09.503281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-662c2698-573e-4ee0-8824-17a47776f763 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:09.504485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-662c2698-573e-4ee0-8824-17a47776f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:09.512639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 699/1406] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:51:09.551019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00fec0-7363-4432-b0f0-56522b6a8d10 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:09.561425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c00fec0-7363-4432-b0f0-56522b6a8d10 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:09.564947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387739e0-1569-4157-820e-2bc3ae9acccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:09.565579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387739e0-1569-4157-820e-2bc3ae9acccb service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:09.565866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387739e0-1569-4157-820e-2bc3ae9acccb service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:09.566142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387739e0-1569-4157-820e-2bc3ae9acccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:09.575281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387739e0-1569-4157-820e-2bc3ae9acccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:09.576728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387739e0-1569-4157-820e-2bc3ae9acccb service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:09.585657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 708/1407] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:11.843704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13667394-a721-4350-8ecf-61e7e057d0a9 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:11.844217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13667394-a721-4350-8ecf-61e7e057d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:11.844217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13667394-a721-4350-8ecf-61e7e057d0a9 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:11.845971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 700/1408] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:11.851836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c33dd-4efb-4783-9ef4-056751009523 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:11.852285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c33dd-4efb-4783-9ef4-056751009523 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:11.852386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c33dd-4efb-4783-9ef4-056751009523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:11.870540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-115c33dd-4efb-4783-9ef4-056751009523 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:11.871755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-115c33dd-4efb-4783-9ef4-056751009523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:11.879381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 709/1409] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:11.918163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13667394-a721-4350-8ecf-61e7e057d0a9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:11.928565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13667394-a721-4350-8ecf-61e7e057d0a9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:11.932589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b11ae-e60b-4ea9-8a96-e4dfc08f8fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:11.933219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b11ae-e60b-4ea9-8a96-e4dfc08f8fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:11.933498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b11ae-e60b-4ea9-8a96-e4dfc08f8fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:11.933774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b11ae-e60b-4ea9-8a96-e4dfc08f8fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:11.942352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b11ae-e60b-4ea9-8a96-e4dfc08f8fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:11.943815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b11ae-e60b-4ea9-8a96-e4dfc08f8fd4 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:11.953287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 701/1410] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:14.198941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e1104-7f37-40c8-b88d-f7b21f8fb2b0 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:14.199508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e1104-7f37-40c8-b88d-f7b21f8fb2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:14.199508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e1104-7f37-40c8-b88d-f7b21f8fb2b0 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:14.201340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 710/1411] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:14.207104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee46c-7c2d-4571-82c7-d54c08c2761b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:14.207536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee46c-7c2d-4571-82c7-d54c08c2761b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:14.207678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cee46c-7c2d-4571-82c7-d54c08c2761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:14.224863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-04cee46c-7c2d-4571-82c7-d54c08c2761b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:14.226038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-04cee46c-7c2d-4571-82c7-d54c08c2761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:14.233559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 702/1412] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:14.271982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e1104-7f37-40c8-b88d-f7b21f8fb2b0 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:14.282176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e1104-7f37-40c8-b88d-f7b21f8fb2b0 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:14.285645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c9d07-ed1e-4423-a0cc-3a3a4bef66b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:14.286271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9d07-ed1e-4423-a0cc-3a3a4bef66b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:14.286807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9d07-ed1e-4423-a0cc-3a3a4bef66b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:14.287084 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c9d07-ed1e-4423-a0cc-3a3a4bef66b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:14.295762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9d07-ed1e-4423-a0cc-3a3a4bef66b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:14.297179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c9d07-ed1e-4423-a0cc-3a3a4bef66b6 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:14.306116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 711/1413] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:31.159995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e0ce-2d33-4bd9-a25b-6a78fee5414b None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:31.160592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e0ce-2d33-4bd9-a25b-6a78fee5414b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:31.160829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e0ce-2d33-4bd9-a25b-6a78fee5414b None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:31.163902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 703/1414] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:31.170378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e634-8a49-4fde-8fe8-5ab680961cc9 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:31.170797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e634-8a49-4fde-8fe8-5ab680961cc9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:31.170928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115e634-8a49-4fde-8fe8-5ab680961cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:31.188722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6115e634-8a49-4fde-8fe8-5ab680961cc9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:31.189901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6115e634-8a49-4fde-8fe8-5ab680961cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:31.197412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 712/1415] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:31.245978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ce33-5d3a-4ec8-8062-d8a86188fed3 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:31.246267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ce33-5d3a-4ec8-8062-d8a86188fed3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:31.246547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99ce33-5d3a-4ec8-8062-d8a86188fed3 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:31.248325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 704/1416] 10.222.0.41 () {54 vars in 962 bytes} [Tue Nov 9 04:51:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:31.253490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b6961-4ea3-4df5-b807-06e59c7b40be None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:31.253778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b6961-4ea3-4df5-b807-06e59c7b40be None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:31.254058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b6961-4ea3-4df5-b807-06e59c7b40be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:31.271505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e19b6961-4ea3-4df5-b807-06e59c7b40be None None] MFA Rules not processed for user `0cef991f3ef34b09ad2251ef7e416a91`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:31.272692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e19b6961-4ea3-4df5-b807-06e59c7b40be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:31.278898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 713/1417] 10.222.0.41 () {58 vars in 1059 bytes} [Tue Nov 9 04:51:31 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:31.286302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ce33-5d3a-4ec8-8062-d8a86188fed3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:31.297141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99ce33-5d3a-4ec8-8062-d8a86188fed3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:31.300569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cfb44-39a0-4a3c-a447-494e3c4f318c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:31.301180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cfb44-39a0-4a3c-a447-494e3c4f318c service glance] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:31.301458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cfb44-39a0-4a3c-a447-494e3c4f318c service glance] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:31.301729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cfb44-39a0-4a3c-a447-494e3c4f318c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:31.310735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cfb44-39a0-4a3c-a447-494e3c4f318c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:31.312177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cfb44-39a0-4a3c-a447-494e3c4f318c service glance] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:31.321061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 705/1418] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:33.783300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e9fb3-1679-4175-908e-2cc4d93ea8e9 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:33.783840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e9fb3-1679-4175-908e-2cc4d93ea8e9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:33.783952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e9fb3-1679-4175-908e-2cc4d93ea8e9 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:33.785808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 714/1419] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:33.792555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840bfc-8dfe-46f5-9128-51bc103ac2ce None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:33.793007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840bfc-8dfe-46f5-9128-51bc103ac2ce None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:33.793305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840bfc-8dfe-46f5-9128-51bc103ac2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:33.810715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-19840bfc-8dfe-46f5-9128-51bc103ac2ce None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:33.811940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-19840bfc-8dfe-46f5-9128-51bc103ac2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:33.820137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 706/1420] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:33.844423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e9fb3-1679-4175-908e-2cc4d93ea8e9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:33.857158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e9fb3-1679-4175-908e-2cc4d93ea8e9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:33.861601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072115f-12e3-40b3-b18c-1717f2c9ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:33.862241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072115f-12e3-40b3-b18c-1717f2c9ada5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:33.862527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072115f-12e3-40b3-b18c-1717f2c9ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:33.862807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072115f-12e3-40b3-b18c-1717f2c9ada5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:33.863555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072115f-12e3-40b3-b18c-1717f2c9ada5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:33.865435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c072115f-12e3-40b3-b18c-1717f2c9ada5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:33.878951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 715/1421] 10.222.0.41 () {56 vars in 1108 bytes} [Tue Nov 9 04:51:33 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:51:36.149562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7317-15ad-49b3-b7f3-71b509ba6e8f None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:36.150642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7317-15ad-49b3-b7f3-71b509ba6e8f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:36.150642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b7317-15ad-49b3-b7f3-71b509ba6e8f None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:36.152389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 707/1422] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:36.158156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0706da5-5d40-4c24-9958-b184e74f1713 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:36.158549 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0706da5-5d40-4c24-9958-b184e74f1713 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:36.158730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0706da5-5d40-4c24-9958-b184e74f1713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:36.176773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f0706da5-5d40-4c24-9958-b184e74f1713 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:36.177961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f0706da5-5d40-4c24-9958-b184e74f1713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:36.185568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 716/1423] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:36.229099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7317-15ad-49b3-b7f3-71b509ba6e8f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:36.243448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b7317-15ad-49b3-b7f3-71b509ba6e8f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:36.248821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcf958-17b1-420d-8476-dc73f3700252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:36.249453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcf958-17b1-420d-8476-dc73f3700252 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:36.249740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcf958-17b1-420d-8476-dc73f3700252 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:36.250018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcf958-17b1-420d-8476-dc73f3700252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:36.257901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcf958-17b1-420d-8476-dc73f3700252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:36.259477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcf958-17b1-420d-8476-dc73f3700252 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:36.268471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 708/1424] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:38.675448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d207-c8a6-4762-819e-3c0906841cc7 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:38.676025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d207-c8a6-4762-819e-3c0906841cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:38.676025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d207-c8a6-4762-819e-3c0906841cc7 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:38.677814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 717/1425] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:38.684187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd6ea-1654-439b-b580-170ae570c4c4 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:38.684597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd6ea-1654-439b-b580-170ae570c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:38.684751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbd6ea-1654-439b-b580-170ae570c4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:38.702172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a2dbd6ea-1654-439b-b580-170ae570c4c4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:38.703346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a2dbd6ea-1654-439b-b580-170ae570c4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:38.711048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 709/1426] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:38.749009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d207-c8a6-4762-819e-3c0906841cc7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:38.759917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d207-c8a6-4762-819e-3c0906841cc7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:38.763434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff567adc-3227-4d9b-8737-deac402b4830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:38.764101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff567adc-3227-4d9b-8737-deac402b4830 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:38.764386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff567adc-3227-4d9b-8737-deac402b4830 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:38.764667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff567adc-3227-4d9b-8737-deac402b4830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:38.773297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff567adc-3227-4d9b-8737-deac402b4830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:38.774731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff567adc-3227-4d9b-8737-deac402b4830 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:38.786440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 718/1427] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:41.073768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02809a-1716-45be-8d25-44fee134789d None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:41.074336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02809a-1716-45be-8d25-44fee134789d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:41.074336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02809a-1716-45be-8d25-44fee134789d None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:41.076153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 710/1428] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:41.081964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44ff5-15eb-4bee-998d-831aa91fe2e6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:41.082407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44ff5-15eb-4bee-998d-831aa91fe2e6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:41.082516 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d44ff5-15eb-4bee-998d-831aa91fe2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:41.100281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-86d44ff5-15eb-4bee-998d-831aa91fe2e6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:41.101463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-86d44ff5-15eb-4bee-998d-831aa91fe2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:41.109079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 719/1429] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:41.147830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02809a-1716-45be-8d25-44fee134789d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:41.158731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02809a-1716-45be-8d25-44fee134789d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:41.162433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb436e1-2e0a-40f4-af35-e96911881eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:41.163059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb436e1-2e0a-40f4-af35-e96911881eda service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:41.163342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb436e1-2e0a-40f4-af35-e96911881eda service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:41.163651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb436e1-2e0a-40f4-af35-e96911881eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:41.172168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb436e1-2e0a-40f4-af35-e96911881eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:41.173592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb436e1-2e0a-40f4-af35-e96911881eda service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:41.183010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 711/1430] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:43.566672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd708-e716-42e5-82a0-960e0e5d65e3 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:43.567195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd708-e716-42e5-82a0-960e0e5d65e3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:43.567299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecd708-e716-42e5-82a0-960e0e5d65e3 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:43.569107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 720/1431] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:43.575077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0920d-5685-43c0-87d8-090479c8f6c7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:43.575482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0920d-5685-43c0-87d8-090479c8f6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:43.575666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0920d-5685-43c0-87d8-090479c8f6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:43.593265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1ad0920d-5685-43c0-87d8-090479c8f6c7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:43.594438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1ad0920d-5685-43c0-87d8-090479c8f6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:43.602356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 712/1432] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:51:43.645035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd708-e716-42e5-82a0-960e0e5d65e3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:43.655330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecd708-e716-42e5-82a0-960e0e5d65e3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:43.658772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2974f3-51f4-4b08-b955-157a76f7efdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:43.659403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2974f3-51f4-4b08-b955-157a76f7efdf service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:43.659717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2974f3-51f4-4b08-b955-157a76f7efdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:43.660001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2974f3-51f4-4b08-b955-157a76f7efdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:43.668813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2974f3-51f4-4b08-b955-157a76f7efdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:43.670231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2974f3-51f4-4b08-b955-157a76f7efdf service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:43.679191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 721/1433] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:51:46.202875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97c40-d059-4159-9870-791446f74278 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:46.203437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97c40-d059-4159-9870-791446f74278 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:46.203437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97c40-d059-4159-9870-791446f74278 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:46.205221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 713/1434] 10.222.0.41 () {54 vars in 926 bytes} [Tue Nov 9 04:51:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:51:46.211099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a39b-9115-4936-a23e-5998c6864876 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:46.211507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a39b-9115-4936-a23e-5998c6864876 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:46.211676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7a39b-9115-4936-a23e-5998c6864876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:46.230026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b7b7a39b-9115-4936-a23e-5998c6864876 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:51:46.231201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b7b7a39b-9115-4936-a23e-5998c6864876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:51:46.238833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 722/1435] 10.222.0.41 () {58 vars in 1023 bytes} [Tue Nov 9 04:51:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:51:46.284324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b97c40-d059-4159-9870-791446f74278 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:51:46.295373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b97c40-d059-4159-9870-791446f74278 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:51:46.298865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee56e4-8bfe-4677-a27e-abe53b21ec33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:51:46.299500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee56e4-8bfe-4677-a27e-abe53b21ec33 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:51:46.299816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee56e4-8bfe-4677-a27e-abe53b21ec33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:51:46.300095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee56e4-8bfe-4677-a27e-abe53b21ec33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:51:46.308823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee56e4-8bfe-4677-a27e-abe53b21ec33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:51:46.310248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee56e4-8bfe-4677-a27e-abe53b21ec33 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:51:46.319244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 714/1436] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:51:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:53:03.916661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:03.917245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:03.917245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:03.935243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:53:03.936465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:53:03.944191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 723/1437] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:53:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:53:03.952701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:03.953187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:03.953290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:03.970683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:53:03.971953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:53:03.979429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 715/1438] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:53:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:53:03.983765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:03.993040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87cb7-8f4c-4bf6-8bd1-f56890695aa6 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:03.998035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:03.998681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:03.998969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:03.999253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.000033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:53:04.000349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.001943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.013605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 724/1439] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:53:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:53:04.021439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.030253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19369ecd-0b36-4eb0-a3dc-57f48528cc42 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.035012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.035779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.036061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.036599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.037328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.039439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.078808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 716/1440] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:53:04 2021] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:53:04.083038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.092937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91487e68-1a63-4971-93c7-7730d1fa1c9f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.145932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.146594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.146884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.147169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.147917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.149842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.170313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 725/1441] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:53:04 2021] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:53:04.175992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.186514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4f2b5-d2fa-404d-87fc-6b61082699a6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.191261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.191940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.192223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.192499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.193230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.194812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.207070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 717/1442] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:53:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:53:04.211025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.220737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f04c45-d699-4f32-a6f1-def63c0a70bc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.225260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d6937-8404-4561-be3f-8eb7cf05a300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.226031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6937-8404-4561-be3f-8eb7cf05a300 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.226314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6937-8404-4561-be3f-8eb7cf05a300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.226616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d6937-8404-4561-be3f-8eb7cf05a300 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.227449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6937-8404-4561-be3f-8eb7cf05a300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.229589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d6937-8404-4561-be3f-8eb7cf05a300 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.242480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 726/1443] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:53:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:53:04.247305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.257501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aefbfc-42bc-4e36-96a0-3188f133286a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.262242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.263108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.263390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.263696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] PATH_INFO: `/v3/projects/aaa49b52848145c9a7cfd5ea62a0543a/users/789353ac49c9435dac6b6f2a32b8d3eb/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.278795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaa49b52848145c9a7cfd5ea62a0543a, user_id=789353ac49c9435dac6b6f2a32b8d3eb, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.281778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.295379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 718/1444] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:53:04 2021] PUT /identity/v3/projects/aaa49b52848145c9a7cfd5ea62a0543a/users/789353ac49c9435dac6b6f2a32b8d3eb/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:53:04.306419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b459d8-e7ce-45b8-9d66-849f37d52f17 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.306717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b459d8-e7ce-45b8-9d66-849f37d52f17 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.306992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b459d8-e7ce-45b8-9d66-849f37d52f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.337741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e8b459d8-e7ce-45b8-9d66-849f37d52f17 None None] MFA Rules not processed for user `789353ac49c9435dac6b6f2a32b8d3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:53:04.338970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e8b459d8-e7ce-45b8-9d66-849f37d52f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:53:04.403817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 727/1445] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:53:04 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:53:04.415362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.482744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e7d1c-b8ad-4cfe-86de-f395c6c53faa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.488159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.488796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.489080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.489358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.497239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.498836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.507251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 719/1446] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:53:04 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:53:04.573898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a10f-6ba8-4327-b4c9-d2f1b7c79dc7 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.574189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a10f-6ba8-4327-b4c9-d2f1b7c79dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.574468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5a10f-6ba8-4327-b4c9-d2f1b7c79dc7 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.576217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 728/1447] 10.222.0.41 () {52 vars in 829 bytes} [Tue Nov 9 04:53:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:53:04.579990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.638569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbe302-efad-4093-9550-75a7e9998ee5 service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.643075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.643962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.644248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.644524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] PATH_INFO: `/v3/users/789353ac49c9435dac6b6f2a32b8d3eb` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.645701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789353ac49c9435dac6b6f2a32b8d3eb)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.646711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:53:04.646711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:53:04.646711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:53:04.647945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.719993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789353ac49c9435dac6b6f2a32b8d3eb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:04.730012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789353ac49c9435dac6b6f2a32b8d3eb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:04.730727 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789353ac49c9435dac6b6f2a32b8d3eb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:04.749894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789353ac49c9435dac6b6f2a32b8d3eb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:04.761866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789353ac49c9435dac6b6f2a32b8d3eb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:04.767793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 720/1448] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:53:04 2021] DELETE /identity/v3/users/789353ac49c9435dac6b6f2a32b8d3eb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:53:04.772311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.772668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.772955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.790445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:53:04.791673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:53:04.846119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 729/1449] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:53:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:53:04.855564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:04.856980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:53:04.912219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447e138-8ac7-4688-a655-f773bd7fb774 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:04.916022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e5a0d-2d70-4ff6-8c27-d28dbf500df6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:04.916798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e5a0d-2d70-4ff6-8c27-d28dbf500df6 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:04.917126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e5a0d-2d70-4ff6-8c27-d28dbf500df6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:04.917405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e5a0d-2d70-4ff6-8c27-d28dbf500df6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:04.927076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e5a0d-2d70-4ff6-8c27-d28dbf500df6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:04.928699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e5a0d-2d70-4ff6-8c27-d28dbf500df6 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:04.937919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 721/1450] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:53:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:53:05.259377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:53:05.260994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:53:05.273601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db03b4-603c-4e2b-b2bc-83a27174415d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:53:05.278258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:53:05.279161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:53:05.279391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:53:05.279706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] PATH_INFO: `/v3/projects/aaa49b52848145c9a7cfd5ea62a0543a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:53:05.280904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaa49b52848145c9a7cfd5ea62a0543a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:53:05.281916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:53:05.281916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:53:05.281916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:53:05.283110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:53:05.341043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaa49b52848145c9a7cfd5ea62a0543a', 'request_id': 'req-05089ff4-4f14-409e-9b79-a49bc0730509'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:05.352750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaa49b52848145c9a7cfd5ea62a0543a', 'request_id': 'req-05089ff4-4f14-409e-9b79-a49bc0730509'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:05.371222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaa49b52848145c9a7cfd5ea62a0543a', 'request_id': 'req-05089ff4-4f14-409e-9b79-a49bc0730509'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:05.389988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] The token cache is being invalidate because project aaa49b52848145c9a7cfd5ea62a0543a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:53:05.390277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:05.390995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-05089ff4-4f14-409e-9b79-a49bc0730509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:53:05.392759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 730/1451] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:53:05 2021] DELETE /identity/v3/projects/aaa49b52848145c9a7cfd5ea62a0543a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:54:32.437197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ddb6-9177-4677-bdfd-926540d26a0b None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:32.437806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ddb6-9177-4677-bdfd-926540d26a0b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:32.437806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855ddb6-9177-4677-bdfd-926540d26a0b None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:32.439542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 722/1452] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 9 04:54:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:32.444843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c9eb-9d0d-4661-acce-2e66b20b49f7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:32.445285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c9eb-9d0d-4661-acce-2e66b20b49f7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:32.445416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2c9eb-9d0d-4661-acce-2e66b20b49f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:32.463397 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b3e2c9eb-9d0d-4661-acce-2e66b20b49f7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:32.464624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b3e2c9eb-9d0d-4661-acce-2e66b20b49f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:32.522751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 731/1453] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 9 04:54:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:32.679485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ddb6-9177-4677-bdfd-926540d26a0b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:32.681206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d855ddb6-9177-4677-bdfd-926540d26a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:32.751534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855ddb6-9177-4677-bdfd-926540d26a0b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:32.756869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ca91-7d61-43f3-927b-e55ba8fb7b04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:32.757505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ca91-7d61-43f3-927b-e55ba8fb7b04 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:32.757787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ca91-7d61-43f3-927b-e55ba8fb7b04 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:32.758065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ca91-7d61-43f3-927b-e55ba8fb7b04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:32.765800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4ca91-7d61-43f3-927b-e55ba8fb7b04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:32.767385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4ca91-7d61-43f3-927b-e55ba8fb7b04 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:32.776390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 723/1454] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:33.005782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13b751-ed19-4b83-9388-22467fc89d8d None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:33.006004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13b751-ed19-4b83-9388-22467fc89d8d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:33.006291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13b751-ed19-4b83-9388-22467fc89d8d None None] PATH_INFO: `/v3` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:33.007678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 732/1455] 10.222.0.20 () {54 vars in 925 bytes} [Tue Nov 9 04:54:33 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:54:33.014853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3745-7777-4bdb-a1d1-eebb8293e395 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:33.015144 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3745-7777-4bdb-a1d1-eebb8293e395 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:33.015444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba3745-7777-4bdb-a1d1-eebb8293e395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:33.034232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-67ba3745-7777-4bdb-a1d1-eebb8293e395 None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:33.035711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-67ba3745-7777-4bdb-a1d1-eebb8293e395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:33.095562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 724/1456] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Nov 9 04:54:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:34.206814 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed83951-8d13-48cd-b570-0b5e0611e406 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:34.207375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed83951-8d13-48cd-b570-0b5e0611e406 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:34.207375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed83951-8d13-48cd-b570-0b5e0611e406 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:34.209187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 733/1457] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 9 04:54:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:34.214359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a93bd-7076-44ce-b4b7-7eeb446807ca None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:34.214805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a93bd-7076-44ce-b4b7-7eeb446807ca None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:34.214928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a93bd-7076-44ce-b4b7-7eeb446807ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:34.232819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-db2a93bd-7076-44ce-b4b7-7eeb446807ca None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:34.234005 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-db2a93bd-7076-44ce-b4b7-7eeb446807ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:34.242702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 725/1458] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 9 04:54:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:34.402659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed83951-8d13-48cd-b570-0b5e0611e406 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:34.417237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed83951-8d13-48cd-b570-0b5e0611e406 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:34.422461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d4a6-2928-403f-8e20-919e0bb04365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:34.423084 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d4a6-2928-403f-8e20-919e0bb04365 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:34.423368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d4a6-2928-403f-8e20-919e0bb04365 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:34.423674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d4a6-2928-403f-8e20-919e0bb04365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:34.432019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0d4a6-2928-403f-8e20-919e0bb04365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:34.433607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0d4a6-2928-403f-8e20-919e0bb04365 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:34.442440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 734/1459] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:41.937379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e726024-2215-42a5-b638-7eef3b8d31fc None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:41.937829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e726024-2215-42a5-b638-7eef3b8d31fc None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:41.937930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e726024-2215-42a5-b638-7eef3b8d31fc None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:41.939765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 726/1460] 10.222.0.41 () {54 vars in 960 bytes} [Tue Nov 9 04:54:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:41.945198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e439b2c-68a7-4166-bee5-1c635a55f8d7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:41.945592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e439b2c-68a7-4166-bee5-1c635a55f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:41.945771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e439b2c-68a7-4166-bee5-1c635a55f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:41.963436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2e439b2c-68a7-4166-bee5-1c635a55f8d7 None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:41.964661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2e439b2c-68a7-4166-bee5-1c635a55f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:41.973681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 735/1461] 10.222.0.41 () {58 vars in 1057 bytes} [Tue Nov 9 04:54:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:41.981399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e726024-2215-42a5-b638-7eef3b8d31fc None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:41.994940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e726024-2215-42a5-b638-7eef3b8d31fc None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:41.999868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a4cea-71e7-4e1e-ab2f-b12654c5fba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:42.000497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4cea-71e7-4e1e-ab2f-b12654c5fba7 service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:42.000782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4cea-71e7-4e1e-ab2f-b12654c5fba7 service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:42.001061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4cea-71e7-4e1e-ab2f-b12654c5fba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:42.009047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a4cea-71e7-4e1e-ab2f-b12654c5fba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:42.010639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a4cea-71e7-4e1e-ab2f-b12654c5fba7 service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:42.020371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 727/1462] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:41 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:46.279028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848708c-6ba3-471a-a271-8c8b21220285 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:46.279602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848708c-6ba3-471a-a271-8c8b21220285 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:46.279602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848708c-6ba3-471a-a271-8c8b21220285 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:46.281387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 736/1463] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 9 04:54:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:46.287783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dddb3-1f75-487a-bf33-4ea8edfb411b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:46.288196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dddb3-1f75-487a-bf33-4ea8edfb411b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:46.288342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157dddb3-1f75-487a-bf33-4ea8edfb411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:46.306189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-157dddb3-1f75-487a-bf33-4ea8edfb411b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:46.307367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-157dddb3-1f75-487a-bf33-4ea8edfb411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:46.314943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 728/1464] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 9 04:54:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:46.466134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848708c-6ba3-471a-a271-8c8b21220285 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:46.480467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848708c-6ba3-471a-a271-8c8b21220285 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:46.485766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e91467f-6ffa-4ae1-b698-516cf60c1ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:46.486940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91467f-6ffa-4ae1-b698-516cf60c1ed2 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:46.487224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91467f-6ffa-4ae1-b698-516cf60c1ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:46.487502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e91467f-6ffa-4ae1-b698-516cf60c1ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:46.495359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91467f-6ffa-4ae1-b698-516cf60c1ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:46.496987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e91467f-6ffa-4ae1-b698-516cf60c1ed2 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:46.508887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 737/1465] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:47.923294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0153-a494-4bac-98bf-360d269a99c8 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:47.924496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0153-a494-4bac-98bf-360d269a99c8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:47.924496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0153-a494-4bac-98bf-360d269a99c8 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:47.926198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 729/1466] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 9 04:54:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:47.931419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdf81c-da6a-413e-8453-d1241e76c036 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:47.931833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdf81c-da6a-413e-8453-d1241e76c036 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:47.932018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdf81c-da6a-413e-8453-d1241e76c036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:47.949423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3bfdf81c-da6a-413e-8453-d1241e76c036 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:47.950608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3bfdf81c-da6a-413e-8453-d1241e76c036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:47.958318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 738/1467] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 9 04:54:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:48.120176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0153-a494-4bac-98bf-360d269a99c8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:48.134197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0153-a494-4bac-98bf-360d269a99c8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:48.139565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90d76e-e4c0-4402-a272-94bfb8b621c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:48.140233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d76e-e4c0-4402-a272-94bfb8b621c5 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:48.140517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d76e-e4c0-4402-a272-94bfb8b621c5 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:48.140792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90d76e-e4c0-4402-a272-94bfb8b621c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:48.149240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90d76e-e4c0-4402-a272-94bfb8b621c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:48.150803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90d76e-e4c0-4402-a272-94bfb8b621c5 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:48.160579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 730/1468] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:52.504086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99599a-ca9f-4516-b09f-e506dbb8f69a None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:52.504944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99599a-ca9f-4516-b09f-e506dbb8f69a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:52.504944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99599a-ca9f-4516-b09f-e506dbb8f69a None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:52.507214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 739/1469] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 9 04:54:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:52.513167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a83dc-8d1a-4d55-892e-c5483b771a25 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:52.513629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a83dc-8d1a-4d55-892e-c5483b771a25 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:52.513729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a83dc-8d1a-4d55-892e-c5483b771a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:52.531339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f64a83dc-8d1a-4d55-892e-c5483b771a25 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:52.532638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f64a83dc-8d1a-4d55-892e-c5483b771a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:52.540545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 731/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 9 04:54:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:52.578694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99599a-ca9f-4516-b09f-e506dbb8f69a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:52.580375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0b99599a-ca9f-4516-b09f-e506dbb8f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:52.637425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99599a-ca9f-4516-b09f-e506dbb8f69a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:52.640903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daff28f-49a2-4aa0-85dd-b4f4ac4e21bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:52.641541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff28f-49a2-4aa0-85dd-b4f4ac4e21bd service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:52.641826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff28f-49a2-4aa0-85dd-b4f4ac4e21bd service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:52.642105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff28f-49a2-4aa0-85dd-b4f4ac4e21bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:52.651161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daff28f-49a2-4aa0-85dd-b4f4ac4e21bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:52.652609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daff28f-49a2-4aa0-85dd-b4f4ac4e21bd service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:52.662365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 740/1471] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:54.983281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3150-4f19-4ac9-8c3d-3e52abe28226 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:54.983864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3150-4f19-4ac9-8c3d-3e52abe28226 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:54.983979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e3150-4f19-4ac9-8c3d-3e52abe28226 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:54.985670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 732/1472] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 9 04:54:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:54.991172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43cb48-071c-4bf1-8d1a-5c9112b44282 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:54.991571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43cb48-071c-4bf1-8d1a-5c9112b44282 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:54.991777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43cb48-071c-4bf1-8d1a-5c9112b44282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:55.009201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2d43cb48-071c-4bf1-8d1a-5c9112b44282 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:55.010387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2d43cb48-071c-4bf1-8d1a-5c9112b44282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:55.018749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 741/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 9 04:54:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:55.056872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3150-4f19-4ac9-8c3d-3e52abe28226 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:55.058534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-869e3150-4f19-4ac9-8c3d-3e52abe28226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:55.071379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e3150-4f19-4ac9-8c3d-3e52abe28226 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:55.074889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056733d-4f67-4397-8963-0756cb2353c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:55.075518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056733d-4f67-4397-8963-0756cb2353c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:55.075832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056733d-4f67-4397-8963-0756cb2353c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:55.076112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056733d-4f67-4397-8963-0756cb2353c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:55.085309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056733d-4f67-4397-8963-0756cb2353c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:55.086725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056733d-4f67-4397-8963-0756cb2353c9 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:55.096365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 733/1474] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:54:59.075321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1eb0-c5ee-433c-9b16-bc0c915a21b8 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:59.075926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1eb0-c5ee-433c-9b16-bc0c915a21b8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:59.075926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1eb0-c5ee-433c-9b16-bc0c915a21b8 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:59.077708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 742/1475] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 9 04:54:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:54:59.083970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd00f2-bb26-497f-a6c6-15498ba6c10e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:59.084434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd00f2-bb26-497f-a6c6-15498ba6c10e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:59.084546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd00f2-bb26-497f-a6c6-15498ba6c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:59.101947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-64fd00f2-bb26-497f-a6c6-15498ba6c10e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:54:59.103110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-64fd00f2-bb26-497f-a6c6-15498ba6c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:59.110744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 734/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 9 04:54:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:54:59.164655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be1eb0-c5ee-433c-9b16-bc0c915a21b8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:54:59.166325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-47be1eb0-c5ee-433c-9b16-bc0c915a21b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:54:59.222382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be1eb0-c5ee-433c-9b16-bc0c915a21b8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:54:59.225813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc753e-1d2e-41c6-b971-8c004db52ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:54:59.226455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc753e-1d2e-41c6-b971-8c004db52ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:54:59.226742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc753e-1d2e-41c6-b971-8c004db52ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:54:59.227019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc753e-1d2e-41c6-b971-8c004db52ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:54:59.235585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc753e-1d2e-41c6-b971-8c004db52ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:54:59.237640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc753e-1d2e-41c6-b971-8c004db52ff7 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:54:59.246897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 743/1477] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:54:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:55:01.486922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a35c5-5d79-4508-95e2-c851dc83d9d8 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:55:01.487452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a35c5-5d79-4508-95e2-c851dc83d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:55:01.487452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a35c5-5d79-4508-95e2-c851dc83d9d8 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:55:01.489318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 735/1478] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 9 04:55:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:55:01.495219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a3bd-0f89-4bbc-b460-34cefa0c73ad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:55:01.495647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a3bd-0f89-4bbc-b460-34cefa0c73ad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:55:01.495791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410a3bd-0f89-4bbc-b460-34cefa0c73ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:55:01.513481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b410a3bd-0f89-4bbc-b460-34cefa0c73ad None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:55:01.514704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b410a3bd-0f89-4bbc-b460-34cefa0c73ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:55:01.522305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 744/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 9 04:55:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:55:01.576339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa43986-b5d1-439c-b198-bb342022d780 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:55:01.576651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa43986-b5d1-439c-b198-bb342022d780 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:55:01.576920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa43986-b5d1-439c-b198-bb342022d780 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:55:01.578731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 736/1480] 10.222.0.41 () {54 vars in 962 bytes} [Tue Nov 9 04:55:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:55:01.584640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ded4f8-f472-435c-b0d9-60a807c243c4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:55:01.584983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ded4f8-f472-435c-b0d9-60a807c243c4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:55:01.585268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ded4f8-f472-435c-b0d9-60a807c243c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:55:01.602983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e8ded4f8-f472-435c-b0d9-60a807c243c4 None None] MFA Rules not processed for user `e261119c7a194c7e814a9dfbf6a4b10f`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:55:01.604191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e8ded4f8-f472-435c-b0d9-60a807c243c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:55:01.610459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 745/1481] 10.222.0.41 () {58 vars in 1059 bytes} [Tue Nov 9 04:55:01 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:55:01.618753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa43986-b5d1-439c-b198-bb342022d780 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:55:01.629686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa43986-b5d1-439c-b198-bb342022d780 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:55:01.633213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c463bc7-aecb-4017-ac3b-28bd475fb9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:55:01.633842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463bc7-aecb-4017-ac3b-28bd475fb9cc service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:55:01.634130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463bc7-aecb-4017-ac3b-28bd475fb9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:55:01.634437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463bc7-aecb-4017-ac3b-28bd475fb9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:55:01.643141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c463bc7-aecb-4017-ac3b-28bd475fb9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:55:01.644609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c463bc7-aecb-4017-ac3b-28bd475fb9cc service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:55:01.653637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 737/1482] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:55:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:24.037837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.038915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.039472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.063017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.064640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.080382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 746/1483] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.089006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.089520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.089603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.115404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.116682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.129237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 738/1484] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.134194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.145335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381add4-6e23-4de2-acbe-2ff13b76a5f0 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.150525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.151448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.151985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.152499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.153474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:24.154120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.156534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.170217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 747/1485] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:24.181854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.194381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e426763-9eb4-437f-982c-b69205c730fa None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.220237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f74fca-6a43-4410-9a0f-32f772f9cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.222106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74fca-6a43-4410-9a0f-32f772f9cddc admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.222749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74fca-6a43-4410-9a0f-32f772f9cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.223543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f74fca-6a43-4410-9a0f-32f772f9cddc admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.224817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f74fca-6a43-4410-9a0f-32f772f9cddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.228191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f74fca-6a43-4410-9a0f-32f772f9cddc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.294268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 739/1486] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:24.308766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.322635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ca65-6a8a-45fb-bff2-f25a88b80e04 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.322952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ca65-6a8a-45fb-bff2-f25a88b80e04 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.323165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ca65-6a8a-45fb-bff2-f25a88b80e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.325696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dc228-259c-496e-baa6-051e4acf3545 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.358973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a3f3ca65-6a8a-45fb-bff2-f25a88b80e04 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.377508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a3f3ca65-6a8a-45fb-bff2-f25a88b80e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.421305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.422617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.423130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.427645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.428662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.430848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.464009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 748/1487] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:24.468767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.483488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc4927-3d2e-4a4d-9453-c777508f12ee admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.486504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 740/1488] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:24.490848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b8a53-e288-4915-9806-1c9889ed28d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.491829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b8a53-e288-4915-9806-1c9889ed28d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.492341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b8a53-e288-4915-9806-1c9889ed28d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.492842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b8a53-e288-4915-9806-1c9889ed28d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.494341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b8a53-e288-4915-9806-1c9889ed28d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.495104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd9967-7478-4551-b8b3-f05ca93acab5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.495402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd9967-7478-4551-b8b3-f05ca93acab5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.499742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd9967-7478-4551-b8b3-f05ca93acab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.501058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b8a53-e288-4915-9806-1c9889ed28d3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.518479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 749/1489] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:24 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:56:24.520237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.520765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.521261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.548855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e4cd9967-7478-4551-b8b3-f05ca93acab5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.549996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e4cd9967-7478-4551-b8b3-f05ca93acab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.552594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.554186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.573944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 750/1490] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.574857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.576601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 741/1491] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:24.579162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.579838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.580266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.591178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02032464-6ea2-434b-a7fe-5a269b5241a4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.605934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3930e-efa7-433a-a65d-d503a115bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.606279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3930e-efa7-433a-a65d-d503a115bcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.606529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3930e-efa7-433a-a65d-d503a115bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.609861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3930e-efa7-433a-a65d-d503a115bcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.609861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3930e-efa7-433a-a65d-d503a115bcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.609861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3930e-efa7-433a-a65d-d503a115bcc6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.627594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 751/1492] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:24 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:24.628960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.629091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.629303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.629588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.630202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.653100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 742/1493] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.654045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.661333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.662519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.669075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff688b-f296-4cb3-8560-ec459d6378e5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.670710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 752/1494] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.671293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.674642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.675373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.675692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.675974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.676841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:24.677161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.678780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a688e7-3a50-42cc-bb63-bd6e351ba6e7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.680797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85d454-fe81-4a26-be3d-11e43ebbfd91 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.685548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e21c-f677-4e35-abc0-7f13f89fbf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.687395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e21c-f677-4e35-abc0-7f13f89fbf44 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.687395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e21c-f677-4e35-abc0-7f13f89fbf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.687592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e21c-f677-4e35-abc0-7f13f89fbf44 admin admin] PATH_INFO: `/v3/projects/3e9bea92048e49debbf053fea8eb2b9f/users/2dc41f90272e4a549aad1634f08342a6/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.693559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 743/1495] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:24.694965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f30ff-f6d2-4104-9cdc-a74eee939838 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.695261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f30ff-f6d2-4104-9cdc-a74eee939838 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.695541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f30ff-f6d2-4104-9cdc-a74eee939838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.703005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e21c-f677-4e35-abc0-7f13f89fbf44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e9bea92048e49debbf053fea8eb2b9f, user_id=2dc41f90272e4a549aad1634f08342a6, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.706449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e21c-f677-4e35-abc0-7f13f89fbf44 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.720473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-846f30ff-f6d2-4104-9cdc-a74eee939838 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.721754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-846f30ff-f6d2-4104-9cdc-a74eee939838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.722868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 753/1496] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:24 2021] PUT /identity/v3/projects/3e9bea92048e49debbf053fea8eb2b9f/users/2dc41f90272e4a549aad1634f08342a6/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:24.724327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.724620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.724904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.750802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.752420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.786830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 744/1497] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.788232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.788534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.788816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.808511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.809689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.820035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 745/1498] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.820035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.829622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 754/1499] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.829622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.836754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc03d03-5ede-43e6-8041-0af23e96d270 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.839132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093dfcb-5c5d-438e-8374-28226e592084 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.841417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.842077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.842364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.842673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.843407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:24.843754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.843868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa4cbe-8b12-4f11-99fb-fc4e70284078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.844520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa4cbe-8b12-4f11-99fb-fc4e70284078 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.844812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa4cbe-8b12-4f11-99fb-fc4e70284078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.845086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa4cbe-8b12-4f11-99fb-fc4e70284078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.845367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6843-8b2d-4f75-a318-4256f80ead79 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.845792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa4cbe-8b12-4f11-99fb-fc4e70284078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.847775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa4cbe-8b12-4f11-99fb-fc4e70284078 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.856912 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 746/1500] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:24.858878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51c9fb-2e16-41ac-9df2-b6570a9a6e40 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.859394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51c9fb-2e16-41ac-9df2-b6570a9a6e40 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.859891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb51c9fb-2e16-41ac-9df2-b6570a9a6e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.878057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 755/1501] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:24.878057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.878057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.878057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.879360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-fb51c9fb-2e16-41ac-9df2-b6570a9a6e40 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.880627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fb51c9fb-2e16-41ac-9df2-b6570a9a6e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.893473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.894696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.941703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 747/1502] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.945252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a203-e823-49f0-8863-34b946050e4e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.945543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a203-e823-49f0-8863-34b946050e4e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.946164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a203-e823-49f0-8863-34b946050e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.959561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 756/1503] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.963930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2d67a203-e823-49f0-8863-34b946050e4e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.964520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:24.965114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2d67a203-e823-49f0-8863-34b946050e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.973656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 748/1504] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:24.974588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972effae-eda7-4280-b58d-b88ba2e1d9d4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:24.974877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.975214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.975443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.981007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:24.981661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.981946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.982222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:24.982965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:24.983398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:24.985043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1138f8d-1e5e-439c-af42-32dae3fa3dd3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:24.992386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:24.993558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:24.996361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 757/1505] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:24.997393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:24.997682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:24.997961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.008522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 749/1506] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:25.009294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.015778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:25.016967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:25.018843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36af9-51bf-4ee4-afbf-45e4c0f728e3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.023335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.024012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.024293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.024569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.025200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 758/1507] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:25.025317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.025959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.027207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.037561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce9d42-70f4-483a-8618-8719912e2240 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.042321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606389da-7b34-48bc-9d51-eebf08677f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.043030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606389da-7b34-48bc-9d51-eebf08677f0c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.043311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606389da-7b34-48bc-9d51-eebf08677f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.043584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606389da-7b34-48bc-9d51-eebf08677f0c admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.044370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606389da-7b34-48bc-9d51-eebf08677f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.047073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606389da-7b34-48bc-9d51-eebf08677f0c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.054662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 750/1508] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.057228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.067892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 759/1509] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.069096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.069383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.069664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.088011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:25.089257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:25.113446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652db29e-3f6d-40f2-9e98-c296c8e33926 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.117069 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.117707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.117987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.118342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.145601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 760/1510] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:25.146442 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.156113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913abd-76e8-47d9-bb1c-cf3221fb06c6 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.161090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.161853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.162018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.162298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.163040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:25.163351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.164983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.176485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 761/1511] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:25.177240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.177931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.179339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.186133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00536b9-4869-4187-92f8-ad338430dd28 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.188868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 751/1512] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:25.189670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.191372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e15a-e220-4d19-a477-a0b61e7e81ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.192051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e15a-e220-4d19-a477-a0b61e7e81ea admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.192344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e15a-e220-4d19-a477-a0b61e7e81ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.192616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e15a-e220-4d19-a477-a0b61e7e81ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.193314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e15a-e220-4d19-a477-a0b61e7e81ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.195218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e15a-e220-4d19-a477-a0b61e7e81ea admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.198403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863e492-eec6-4e8c-b1ed-356f57e7dac6 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.203455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.204481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.204900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.205368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.206579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:25.207080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.209666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.228274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 762/1513] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.228274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.228274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.228274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.231781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 752/1514] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:25.234180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.247742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6e079-f24d-4b56-b70b-3090a7137c44 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.248256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:25.249625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:25.312814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.313496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.313784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.314064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.314806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.316833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.321220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 763/1515] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:25.321916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.332025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72784472-5725-403d-ae2e-3e089c6edc10 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.337456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.338403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.338693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.338990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.339870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.341574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.345476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 753/1516] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.346311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.353042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 764/1517] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:25.356085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.359856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed571184-e705-4e64-ab21-5b21a15067b6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.364843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.365108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bd86e-70fc-4f24-aa9b-4926c0c87bcc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.365827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.366109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.366451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.367306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:25.367709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.369478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.370221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.370936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.371293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.371657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.372454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.375786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.394357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 754/1518] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:25.394357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.402933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b10c9a-58af-4897-8166-47dce2d22505 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.407931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.408960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.409338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.409919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.410922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.413436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.421836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 765/1519] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.422473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.440940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 755/1520] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.441864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.451264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe22d-1304-4b91-bdab-643070193f2c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.521197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c79b7-de4b-41b1-8f28-5ab2bc9ca0e5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.526085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.526816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.527174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.527521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.528354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.528480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.529245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.529603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.530074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.530722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.530983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:25.531364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.533071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.553351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 756/1521] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:25.553351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.571067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 766/1522] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.571984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.572712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a89268-344d-44b0-9052-1e905527b9aa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.644012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32eaa7-c504-4e75-8113-3bd59752bd7b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.645539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.646823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.647219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.647559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.648514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.649098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.649807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.650328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.650437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.650613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.651359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.653009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.664016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 767/1523] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:25.664920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.665366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 757/1524] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:25.666453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.675421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb596dc7-c778-434f-858b-e45170f9010e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.679402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b48cf-678f-416e-97e7-f00ce00d67e8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.680807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.681562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.682023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.682371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.683151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.685087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.685815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.687066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.687354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.687646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.688358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.690403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.715239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 758/1525] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/users => generated 287 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.716405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 768/1526] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.722063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.723119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.731275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070f1eb-debd-47bf-8d82-082cb40197c1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.795301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.796049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.796327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.796608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.797354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.798714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c023-fee8-48bd-8a93-e83a648dcbdf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.798968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.804204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.804948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.805228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.805506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.806219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.808433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.811662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 759/1527] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:25.812475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.822270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f23b45-0dc6-480c-9738-57452adc7824 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.827759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.828497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.828780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.829137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.829850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.831913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.842152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 769/1528] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.843756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.861747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 760/1529] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:25.862742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.872601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306ab74-9540-4026-9919-f1dd60598bde admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.913625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31292d3-af9b-4aef-8543-f82abe426e69 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.919449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.919951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.921188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.921188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.921613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.923826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.933684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.934582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.935047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.935162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] PATH_INFO: `/v3/projects/df921510edf34ac09f5be957837f5546/users/115a975a272c4ad9a5e93a38ee1c8180/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.936057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 770/1530] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:25.941683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.953061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df921510edf34ac09f5be957837f5546, user_id=115a975a272c4ad9a5e93a38ee1c8180, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.953742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f655971-19f1-4eff-9fbc-bb5e5899f28c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:25.955783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.958545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:25.959213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:25.960009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:25.960009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:25.960550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:25.962805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:25.972655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 761/1531] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:25 2021] PUT /identity/v3/projects/df921510edf34ac09f5be957837f5546/users/115a975a272c4ad9a5e93a38ee1c8180/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:25.982214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.982543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 771/1532] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:25.982543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:25.992428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de0227-b0be-43d2-9560-ffd7b465fd99 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.046275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec4c83-ee2f-446e-bf0f-d157d0943c15 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.050825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.051360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.051477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.051907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.052080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.052226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.052448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.052742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.053172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.053694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.054928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.055951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.065082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 772/1533] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:25 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.065908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.077448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89fd9e-b155-4b33-a088-fd8f7be42a67 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.079181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 762/1534] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:25 2021] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:26.080387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.086226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41104d2-85a9-474a-b0a6-b2800943d963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.086914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41104d2-85a9-474a-b0a6-b2800943d963 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.087237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41104d2-85a9-474a-b0a6-b2800943d963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.087560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41104d2-85a9-474a-b0a6-b2800943d963 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.088303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41104d2-85a9-474a-b0a6-b2800943d963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.090276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41104d2-85a9-474a-b0a6-b2800943d963 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.090439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ea001-f224-439b-99e2-8b52ae8e1ef4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.095643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.096298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.096580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.096854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.097599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.099315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.110735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 763/1535] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.111534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.116162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 773/1536] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/users => generated 291 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:26.117465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf206d-b39a-472a-ba29-3e6f00893751 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.117791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf206d-b39a-472a-ba29-3e6f00893751 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.118079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf206d-b39a-472a-ba29-3e6f00893751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.124181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b29593-736b-47ab-845a-2edb5c7aee54 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.128920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.129817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.130099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.130532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] PATH_INFO: `/v3/projects/eb9dcad090d247508d51df3c835b3ab6/users/d6804d4b04ac46cea0bb163161891f49/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.138921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-55bf206d-b39a-472a-ba29-3e6f00893751 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.140367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-55bf206d-b39a-472a-ba29-3e6f00893751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.145629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9dcad090d247508d51df3c835b3ab6, user_id=d6804d4b04ac46cea0bb163161891f49, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.151931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.152253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 774/1537] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:26.152253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.152253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.152253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.167061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 764/1538] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:26 2021] PUT /identity/v3/projects/eb9dcad090d247508d51df3c835b3ab6/users/d6804d4b04ac46cea0bb163161891f49/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:26.177338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.187301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] MFA Rules not processed for user `2dc41f90272e4a549aad1634f08342a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.188608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.238616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ead3e1-5f03-47f7-9375-7d5732881f89 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.243183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.243874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.244158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.244437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.245254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.246839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.253667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 775/1539] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:26.254682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.263652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 765/1540] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.263652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.268976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6212c-be85-402c-8bb9-f46b3bd93d77 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.269792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3723a-f7da-442d-8241-39659b299244 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.273439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.274271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.274401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.274615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.274891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] PATH_INFO: `/v3/projects/27238c465f3941fb932e099dca430763/users/592dc580513e4330b1e64575920f0a8e/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.275011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.275699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.276002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.276767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.278351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.288765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 766/1541] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.289610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.290391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27238c465f3941fb932e099dca430763, user_id=592dc580513e4330b1e64575920f0a8e, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.293253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.298938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162d494-c27f-4ee9-987b-2ad11ac4e988 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.303814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.304466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.304753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.305031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.305763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.306063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 776/1542] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:26 2021] PUT /identity/v3/projects/27238c465f3941fb932e099dca430763/users/592dc580513e4330b1e64575920f0a8e/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:26.306913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.307339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.317319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 767/1543] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.318102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.367847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951bea2-3d1e-4ba7-b8dc-d94a1b5bfef2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.370359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede399ff-5efc-4856-b0ca-ec250f7dddcf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.372427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afea42-91b4-4f37-8b9f-4e2acabab67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.373087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afea42-91b4-4f37-8b9f-4e2acabab67a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.373369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afea42-91b4-4f37-8b9f-4e2acabab67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.373765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afea42-91b4-4f37-8b9f-4e2acabab67a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.375018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afea42-91b4-4f37-8b9f-4e2acabab67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.376631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afea42-91b4-4f37-8b9f-4e2acabab67a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.386210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 777/1544] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.387594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687473-e22a-4582-a197-73dbf30f4041 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.388024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687473-e22a-4582-a197-73dbf30f4041 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.388437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24687473-e22a-4582-a197-73dbf30f4041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.417222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-24687473-e22a-4582-a197-73dbf30f4041 None None] MFA Rules not processed for user `d6804d4b04ac46cea0bb163161891f49`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.417657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.418313 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.418454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-24687473-e22a-4582-a197-73dbf30f4041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.418591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.418867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.427843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.429257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.438413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 768/1545] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:26.439239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.448351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1c06c-fbc3-403a-b59b-8f29b30f423d service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.454283 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.455295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.455581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.455889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] PATH_INFO: `/v3/projects/3d61cd1d8c9548baa4d4144d3e0a6eb7/users/4587036edcab42c68048d18ba8973023/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.472707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d61cd1d8c9548baa4d4144d3e0a6eb7, user_id=4587036edcab42c68048d18ba8973023, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.476233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.490012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 778/1546] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:26.490574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 769/1547] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:26 2021] PUT /identity/v3/projects/3d61cd1d8c9548baa4d4144d3e0a6eb7/users/4587036edcab42c68048d18ba8973023/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:26.491404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.492025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a1ae-d2ad-42bf-883d-d44b24a66fb2 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.492659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a1ae-d2ad-42bf-883d-d44b24a66fb2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.493348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0a1ae-d2ad-42bf-883d-d44b24a66fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.512104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f8d0a1ae-d2ad-42bf-883d-d44b24a66fb2 None None] MFA Rules not processed for user `2dc41f90272e4a549aad1634f08342a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.513307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f8d0a1ae-d2ad-42bf-883d-d44b24a66fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.558724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe11b38-695c-4de2-9ed4-2e2fcf3299f6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.567090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.567090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.567090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.567090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.567561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.567805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.577535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 779/1548] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:26.578646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.578944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.579230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.585004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 770/1549] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.585844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.596481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd7e38-ccea-4745-b226-e6eaf753f241 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.597731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.598991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.606761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3472166-a592-42f0-9efd-aef55ab9adf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.608162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 780/1550] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:26.608803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.609215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472166-a592-42f0-9efd-aef55ab9adf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.609666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472166-a592-42f0-9efd-aef55ab9adf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.610106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472166-a592-42f0-9efd-aef55ab9adf6 admin admin] PATH_INFO: `/v3/projects/6ca9c79d07d446299c631cb3712e3115/users/1b9f550ad685434a833bb9cce5089d6e/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.618327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118aa17-33a5-4275-9915-a15533c92c89 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.624451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.624451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.624677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.624920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.625830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.627460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.639517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 781/1551] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:26.640858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.640994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3472166-a592-42f0-9efd-aef55ab9adf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca9c79d07d446299c631cb3712e3115, user_id=1b9f550ad685434a833bb9cce5089d6e, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.644257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3472166-a592-42f0-9efd-aef55ab9adf6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.654168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963f4ca-ad37-493a-af7e-c31f95d4e298 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.671774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 771/1552] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:26 2021] PUT /identity/v3/projects/6ca9c79d07d446299c631cb3712e3115/users/1b9f550ad685434a833bb9cce5089d6e/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:26.671774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e81c1-b7e5-4a61-8a52-f78dc5c03d39 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.671774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e81c1-b7e5-4a61-8a52-f78dc5c03d39 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.671774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e81c1-b7e5-4a61-8a52-f78dc5c03d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.706408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3f5e81c1-b7e5-4a61-8a52-f78dc5c03d39 None None] MFA Rules not processed for user `4587036edcab42c68048d18ba8973023`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.707188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3f5e81c1-b7e5-4a61-8a52-f78dc5c03d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.715432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.716223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.716576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.716886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.717656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.719550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.746574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 782/1553] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:26.747459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.785734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 772/1554] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:26.787261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d42c4e-195e-4a82-bdc7-a129bc90d588 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.787559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d42c4e-195e-4a82-bdc7-a129bc90d588 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.787864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d42c4e-195e-4a82-bdc7-a129bc90d588 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.789951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 773/1555] 10.222.0.41 () {54 vars in 960 bytes} [Tue Nov 9 04:56:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:56:26.791174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d42c4e-195e-4a82-bdc7-a129bc90d588 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.820098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c51bb-0142-4721-86eb-329ee2d8f9f8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.825574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.827437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.827823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.828204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] PATH_INFO: `/v3/projects/03305e25979a4de2b9bf721e0ac9fabe/users/d77e7d6b09ac482f8bf1bcf4c83ed05e/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.846736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03305e25979a4de2b9bf721e0ac9fabe, user_id=d77e7d6b09ac482f8bf1bcf4c83ed05e, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.850354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.858195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d42c4e-195e-4a82-bdc7-a129bc90d588 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.862221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f75320-a2b9-4cfb-a13d-c9edf07d7fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.862879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75320-a2b9-4cfb-a13d-c9edf07d7fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.863166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75320-a2b9-4cfb-a13d-c9edf07d7fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.863446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f75320-a2b9-4cfb-a13d-c9edf07d7fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.871218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 783/1556] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:26 2021] PUT /identity/v3/projects/03305e25979a4de2b9bf721e0ac9fabe/users/d77e7d6b09ac482f8bf1bcf4c83ed05e/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:26.872005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:26.877149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f75320-a2b9-4cfb-a13d-c9edf07d7fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.878599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f75320-a2b9-4cfb-a13d-c9edf07d7fe2 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.888963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 774/1557] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:26.890913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.891209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.891491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.920308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] MFA Rules not processed for user `1b9f550ad685434a833bb9cce5089d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:26.922467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:26.947012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf421ab1-1e86-4692-97e4-c3d13551ce7e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:26.952958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:26.953832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:26.954277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:26.954593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] PATH_INFO: `/v3/projects/fc526af9a596432792174a3cf4c232cb/users/81c8e038f41c4d099c159c3c9e6c3a6b/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:26.971688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc526af9a596432792174a3cf4c232cb, user_id=81c8e038f41c4d099c159c3c9e6c3a6b, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:26.974837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:26.989721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 784/1558] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:26 2021] PUT /identity/v3/projects/fc526af9a596432792174a3cf4c232cb/users/81c8e038f41c4d099c159c3c9e6c3a6b/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:26.990416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.000422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 775/1559] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:27.001338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.018714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d52352-5450-44f6-b9a9-e216dfb86314 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.068261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26de99-1f2a-498e-8a54-1ea1aa82a0a2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.073513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320259d-59dd-423d-aeed-fa2ca9951e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.074356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320259d-59dd-423d-aeed-fa2ca9951e06 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.074800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320259d-59dd-423d-aeed-fa2ca9951e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.075122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320259d-59dd-423d-aeed-fa2ca9951e06 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.075812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320259d-59dd-423d-aeed-fa2ca9951e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.078502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320259d-59dd-423d-aeed-fa2ca9951e06 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.079038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa4eca1-48df-4df8-9cb4-28f1b01b838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.080168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4eca1-48df-4df8-9cb4-28f1b01b838f admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.080168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4eca1-48df-4df8-9cb4-28f1b01b838f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.080492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa4eca1-48df-4df8-9cb4-28f1b01b838f admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.081311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4eca1-48df-4df8-9cb4-28f1b01b838f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.083290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa4eca1-48df-4df8-9cb4-28f1b01b838f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.102666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 785/1560] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:26 2021] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:27.105308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066333d-1641-4e6d-98e2-425ae793f187 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.106200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066333d-1641-4e6d-98e2-425ae793f187 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.106563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066333d-1641-4e6d-98e2-425ae793f187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.117172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 776/1561] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:27.118908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91f57e-bb01-4f2e-842e-bbbfba63a993 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.119224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91f57e-bb01-4f2e-842e-bbbfba63a993 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.119681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91f57e-bb01-4f2e-842e-bbbfba63a993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.127426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2066333d-1641-4e6d-98e2-425ae793f187 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:27.128703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2066333d-1641-4e6d-98e2-425ae793f187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:27.138656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0e91f57e-bb01-4f2e-842e-bbbfba63a993 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:27.140557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0e91f57e-bb01-4f2e-842e-bbbfba63a993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:27.200495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 786/1562] 10.222.0.41 () {58 vars in 1057 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:27.202640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83b04-a682-40bf-8381-62661575ea66 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.203045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83b04-a682-40bf-8381-62661575ea66 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.203431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c83b04-a682-40bf-8381-62661575ea66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.208618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 777/1563] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:27.210753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cff0-e590-4f32-b2df-6e9d122efc1f None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.211927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cff0-e590-4f32-b2df-6e9d122efc1f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.212590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6cff0-e590-4f32-b2df-6e9d122efc1f None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.214931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 778/1564] 10.222.0.41 () {54 vars in 960 bytes} [Tue Nov 9 04:56:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:56:27.215950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cff0-e590-4f32-b2df-6e9d122efc1f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.231365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-39c83b04-a682-40bf-8381-62661575ea66 None None] MFA Rules not processed for user `81c8e038f41c4d099c159c3c9e6c3a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:27.232494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6cff0-e590-4f32-b2df-6e9d122efc1f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.232634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-39c83b04-a682-40bf-8381-62661575ea66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:27.240291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.241187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.241554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.241948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.242930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.244694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.256865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 779/1565] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:27.257832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.268382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada218f-7dc7-447f-9511-9286f6f0293d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.274167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.274833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.275120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.275396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.276143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.278239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.303518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 780/1566] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:27.303518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.310087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 787/1567] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:27.314913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.315217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.315499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.315889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3038f-436b-4567-9576-2f4d1a422312 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.321854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.322441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.322876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.323052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.342280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:27.344091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:27.354144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 788/1568] 10.222.0.41 () {58 vars in 1057 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:27.354967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.410588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.413298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.428300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 781/1569] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:27.429215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.432989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36354377-eaef-4e31-a184-7d81dd6ad173 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.437782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.438962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.439319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.439737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.441700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fdd44-1d54-4df3-97b6-cdf8f852984b service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.448301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.449544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.449853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.450272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] PATH_INFO: `/v3/projects/64b4caba45de4fe3b8899f3d515875f6/users/47430fca72c44b4ba630ebca747bde91/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.456272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.458121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.472986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 789/1570] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:27.474117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.478105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b4caba45de4fe3b8899f3d515875f6, user_id=47430fca72c44b4ba630ebca747bde91, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.481458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.484927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62050-7200-49ae-81dc-0d3c883bdfc1 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.490819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.491592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.492099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.492478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.493373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.495371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.507651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 790/1571] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:27.509196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.512564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 782/1572] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:27 2021] PUT /identity/v3/projects/64b4caba45de4fe3b8899f3d515875f6/users/47430fca72c44b4ba630ebca747bde91/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:27.513604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.522981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3d72-f6f8-4263-a630-608189da141f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.609200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1dc9-a280-43fa-aefb-e3fe9fcdfe08 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.617295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.618552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.618970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.619463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.619657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.620152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.620768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.621385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.622962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.626950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.664916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 791/1573] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:27.666520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.704651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.708089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.719766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 783/1574] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:27.720619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.745841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35eb75-572b-42fd-928a-e23754ea28cd service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.791390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaf48a-c0d0-4ce1-9df0-89f48df35943 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.800709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.801750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.802140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.802546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] PATH_INFO: `/v3/projects/52b00633f3684a229f4572d5365aa533/users/eff287c96b69400db6c6de90661dae6e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.832222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.832655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.832936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.833252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.834436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.835771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.836908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b00633f3684a229f4572d5365aa533, user_id=eff287c96b69400db6c6de90661dae6e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.839955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.851495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 784/1575] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:27.853245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.865036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a50249-4c1c-4ac5-9f90-a53915fba8c4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.873549 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 792/1576] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:27 2021] PUT /identity/v3/projects/52b00633f3684a229f4572d5365aa533/users/eff287c96b69400db6c6de90661dae6e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:27.874966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.939094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.939955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.940238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.940516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.941284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.944057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:27.974457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 785/1577] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:27 2021] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:27.975527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:27.988136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41611e-1ed8-4c1a-b979-2d59d3b68238 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:27.994543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:27.995224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:27.995532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:27.995946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:27.996884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:27.999814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.012080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 786/1578] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:27 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:28.012999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:28.026767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73920390-7e14-4ccd-86c8-6c4fdefaf77a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:28.032975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eedda-7018-475f-bd78-5b18f59ca1f0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:28.037011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a011320-c722-48ae-9e6c-f1f68f9a7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:28.038118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011320-c722-48ae-9e6c-f1f68f9a7a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.039189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011320-c722-48ae-9e6c-f1f68f9a7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.039673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a011320-c722-48ae-9e6c-f1f68f9a7a1b admin admin] PATH_INFO: `/v3/projects/64b4caba45de4fe3b8899f3d515875f6/users/47430fca72c44b4ba630ebca747bde91/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.049632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c94f7b-73ee-4c67-b7d0-0383ab91a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:28.049632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94f7b-73ee-4c67-b7d0-0383ab91a98b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.049632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94f7b-73ee-4c67-b7d0-0383ab91a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.049632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c94f7b-73ee-4c67-b7d0-0383ab91a98b admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.050519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011320-c722-48ae-9e6c-f1f68f9a7a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b4caba45de4fe3b8899f3d515875f6, user_id=47430fca72c44b4ba630ebca747bde91, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:28.050617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94f7b-73ee-4c67-b7d0-0383ab91a98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:28.050722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a011320-c722-48ae-9e6c-f1f68f9a7a1b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.055232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c94f7b-73ee-4c67-b7d0-0383ab91a98b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.067358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 793/1579] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:27 2021] PUT /identity/v3/projects/64b4caba45de4fe3b8899f3d515875f6/users/47430fca72c44b4ba630ebca747bde91/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:28.070168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bac56-774a-4d1c-9b9c-22c798828c17 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.071930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bac56-774a-4d1c-9b9c-22c798828c17 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.073644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bac56-774a-4d1c-9b9c-22c798828c17 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.076556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 794/1580] 10.222.0.41 () {54 vars in 912 bytes} [Tue Nov 9 04:56:28 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:56:28.078340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bac56-774a-4d1c-9b9c-22c798828c17 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:28.084290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 787/1581] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:28 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:28.088025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.088314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.088594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.161967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] MFA Rules not processed for user `47430fca72c44b4ba630ebca747bde91`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:28.163190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:28.207842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bac56-774a-4d1c-9b9c-22c798828c17 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:28.214502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca6d15-3cc7-4644-8914-0cd07901b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:28.215898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca6d15-3cc7-4644-8914-0cd07901b7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.216474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca6d15-3cc7-4644-8914-0cd07901b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.216909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca6d15-3cc7-4644-8914-0cd07901b7b2 admin admin] PATH_INFO: `/v3/projects/52b00633f3684a229f4572d5365aa533/users/eff287c96b69400db6c6de90661dae6e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.221786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca6d15-3cc7-4644-8914-0cd07901b7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b00633f3684a229f4572d5365aa533, user_id=eff287c96b69400db6c6de90661dae6e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:28.227242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca6d15-3cc7-4644-8914-0cd07901b7b2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.243692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 795/1582] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:28 2021] PUT /identity/v3/projects/52b00633f3684a229f4572d5365aa533/users/eff287c96b69400db6c6de90661dae6e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:28.245729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339605-3d06-4bf9-836c-9fcadfc7aec0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.246202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339605-3d06-4bf9-836c-9fcadfc7aec0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.246634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339605-3d06-4bf9-836c-9fcadfc7aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.296539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-1d339605-3d06-4bf9-836c-9fcadfc7aec0 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:28.302780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1d339605-3d06-4bf9-836c-9fcadfc7aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:28.354286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 788/1583] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:28 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:28.355411 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:28.383415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0dcd70-2da4-4488-a5cb-c269c5ac8151 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:28.491494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:28.495394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.495903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.496546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] PATH_INFO: `/v3/projects/041d2562b8034579b9f26165bfe13762/users/e14d6ca7272e4404afa2af26f6e31d6a/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.509926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 796/1584] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:56:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:28.514304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0874-5c16-4ca5-925c-e34a8c4a982f None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.514734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0874-5c16-4ca5-925c-e34a8c4a982f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.515119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd0874-5c16-4ca5-925c-e34a8c4a982f None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.524482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 797/1585] 10.222.0.41 () {54 vars in 912 bytes} [Tue Nov 9 04:56:28 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:56:28.525983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b69a-4a70-4d32-a8aa-892a53b25fc3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.526550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b69a-4a70-4d32-a8aa-892a53b25fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.528231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51b69a-4a70-4d32-a8aa-892a53b25fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.534965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041d2562b8034579b9f26165bfe13762, user_id=e14d6ca7272e4404afa2af26f6e31d6a, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:28.539418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.560738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8a51b69a-4a70-4d32-a8aa-892a53b25fc3 None None] MFA Rules not processed for user `eff287c96b69400db6c6de90661dae6e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:28.562516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 789/1586] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:28 2021] PUT /identity/v3/projects/041d2562b8034579b9f26165bfe13762/users/e14d6ca7272e4404afa2af26f6e31d6a/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:28.563169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8a51b69a-4a70-4d32-a8aa-892a53b25fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:28.563942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:28.689786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 798/1587] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:28 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:28.692709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.693196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.693636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.712576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc970c-99f6-4537-baf0-a3decd834b05 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:28.720289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:28.721925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:28.722800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:28.723583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.725419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.725818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.803599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 799/1588] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:56:28 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:28.804927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:28.806904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:28.868189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:28.869916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.989882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f231c35-083f-4c59-9894-52bf303b00c3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:28.989882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:28.989882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:28.989882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:28.991119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:28.991309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 790/1589] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:28 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:28.991309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:28.991477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:28.991477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:28.991477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 800/1590] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:28.991477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:29.003727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d065c1f-d0f8-4afa-9b99-10ac2672bbcb service glance] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:29.009325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:29.011566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.012046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.012513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.028128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:29.032202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:29.068142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 801/1591] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:28 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:29.070994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:29.100345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17c124-4a27-47b4-8a12-808e1f5ee6fa service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:29.110665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:29.111330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.111614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.113891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.135177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630835-24cf-4d4c-a23b-7f6dfb6ce8a4 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:29.140321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:29.144046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:29.169067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4ab83-9715-4547-857e-987319bf5426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:29.169784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ab83-9715-4547-857e-987319bf5426 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.170071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ab83-9715-4547-857e-987319bf5426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.170351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ab83-9715-4547-857e-987319bf5426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.174536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 802/1592] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:29.175042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4ab83-9715-4547-857e-987319bf5426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:29.178653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4ab83-9715-4547-857e-987319bf5426 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:29.207808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 791/1593] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:28 2021] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:29.209139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:29.224999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b2e4-8ea3-4404-96e8-3590f5e8b540 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:29.244376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:29.245586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.246032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.246340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] PATH_INFO: `/v3/projects/041d2562b8034579b9f26165bfe13762/users/e14d6ca7272e4404afa2af26f6e31d6a/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.250758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041d2562b8034579b9f26165bfe13762, user_id=e14d6ca7272e4404afa2af26f6e31d6a, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:29.253649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:29.265985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 803/1594] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:29 2021] PUT /identity/v3/projects/041d2562b8034579b9f26165bfe13762/users/e14d6ca7272e4404afa2af26f6e31d6a/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:29.279819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.280760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.281240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.333457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] MFA Rules not processed for user `e14d6ca7272e4404afa2af26f6e31d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:29.335288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:29.352625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:29.431729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 792/1595] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:29 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:29.438317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:29.444292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e1da5-c2c7-4f33-8820-56d611e7c2f6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:29.449908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d996c8-7cac-4310-b632-726aa50816e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:29.451127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d996c8-7cac-4310-b632-726aa50816e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.451858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d996c8-7cac-4310-b632-726aa50816e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.452483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d996c8-7cac-4310-b632-726aa50816e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.515438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d898d-9b39-443e-b267-21037ad0598e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:29.522214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:29.523268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.523644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.523933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] PATH_INFO: `/v3/users/81c8e038f41c4d099c159c3c9e6c3a6b` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.525624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c8e038f41c4d099c159c3c9e6c3a6b)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:29.528439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:29.540395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d996c8-7cac-4310-b632-726aa50816e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:29.542172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d996c8-7cac-4310-b632-726aa50816e4 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:29.561328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 804/1596] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:29 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:56:29.604841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c8e038f41c4d099c159c3c9e6c3a6b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:29.618152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c8e038f41c4d099c159c3c9e6c3a6b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:29.619071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c8e038f41c4d099c159c3c9e6c3a6b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:29.636155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c8e038f41c4d099c159c3c9e6c3a6b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:29.649520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8faebb48-507a-4cd7-8e0f-579daa9ca16a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c8e038f41c4d099c159c3c9e6c3a6b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:29.666427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 793/1597] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:29 2021] DELETE /identity/v3/users/81c8e038f41c4d099c159c3c9e6c3a6b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:29.668353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.668775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.669165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.687090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebfa39-e5af-4907-b786-00868bdb3d21 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.687503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebfa39-e5af-4907-b786-00868bdb3d21 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.687942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebfa39-e5af-4907-b786-00868bdb3d21 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.690322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 794/1598] 10.222.0.41 () {54 vars in 912 bytes} [Tue Nov 9 04:56:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:56:29.700068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:29.700507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:29.700893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:29.710679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:29.714364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:29.832227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] MFA Rules not processed for user `91a0c407ceb84296be75ad28880f64cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:29.840779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:29.919152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 805/1599] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:29.931481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:29.933465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:29.996894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 795/1600] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:56:29 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:30.027794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:30.029226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:30.050407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbebab-9085-428d-8e09-c94cea01a074 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:30.060867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:30.062124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:30.062478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:30.068626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:30.093082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:30.093926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db54e3-f370-4ae0-bebc-cd7d73ec4316 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:30.094552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:30.104495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7318f3c-1766-4aa0-ba26-387ba3b87aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:30.105174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7318f3c-1766-4aa0-ba26-387ba3b87aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:30.105468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7318f3c-1766-4aa0-ba26-387ba3b87aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:30.105753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7318f3c-1766-4aa0-ba26-387ba3b87aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:30.128314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 796/1601] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:30 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:56:30.132648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7318f3c-1766-4aa0-ba26-387ba3b87aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:30.134335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7318f3c-1766-4aa0-ba26-387ba3b87aa3 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:30.153668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 806/1602] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:56:30.520247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:30.522045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:30.683023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59140-0afc-4d80-85e2-824a59fce4b0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:30.683387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59140-0afc-4d80-85e2-824a59fce4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:30.683732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c59140-0afc-4d80-85e2-824a59fce4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:30.709646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50279f-6f9d-4078-9959-543800ba439f service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:30.726262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47430fca72c44b4ba630ebca747bde91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b4caba45de4fe3b8899f3d515875f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:30.727073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:30.727368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:30.727689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:30.728467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:30.728784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:30.731552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:30.751788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-05c59140-0afc-4d80-85e2-824a59fce4b0 None None] MFA Rules not processed for user `592dc580513e4330b1e64575920f0a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:30.756958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-05c59140-0afc-4d80-85e2-824a59fce4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:30.761660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 797/1603] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:30.763009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:30.777572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd446d-cf09-41ea-a7cd-e23673108191 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:30.793590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47430fca72c44b4ba630ebca747bde91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b4caba45de4fe3b8899f3d515875f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:30.794726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:30.796400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:30.796996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:30.798658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:30.802806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:30.865444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 798/1604] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:30 2021] POST /identity/v3/projects => generated 354 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:30.866977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:30.914798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 807/1605] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:30 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:30.928371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:30.928817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:30.929255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:30.971011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] MFA Rules not processed for user `592dc580513e4330b1e64575920f0a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:30.973425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.015140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5103221-2539-451f-9e1a-5d901cff180b tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:31.028647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47430fca72c44b4ba630ebca747bde91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b4caba45de4fe3b8899f3d515875f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:31.029464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:31.030437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:31.030834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:31.032025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:31.032223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:31.034262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:31.051353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 799/1606] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:31.087494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 808/1607] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:30 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:31.097026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:31.098894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.124472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:31.139929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08130d3e-b02e-47e4-86c0-c8ef56bed954 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:31.145510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47430fca72c44b4ba630ebca747bde91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '64b4caba45de4fe3b8899f3d515875f6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:31.146649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:31.146942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:31.147225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] PATH_INFO: `/v3/projects/7edd94a1732d4a018426e8b55d0eeda7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:31.148634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7edd94a1732d4a018426e8b55d0eeda7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:31.150807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:31.211920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daf4bf-a731-4cd8-8e89-747cd126025d tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:31.239353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7edd94a1732d4a018426e8b55d0eeda7', 'request_id': 'req-1606c512-6922-4034-b420-3d1f111dbd66'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.273053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7edd94a1732d4a018426e8b55d0eeda7', 'request_id': 'req-1606c512-6922-4034-b420-3d1f111dbd66'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.297112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7edd94a1732d4a018426e8b55d0eeda7', 'request_id': 'req-1606c512-6922-4034-b420-3d1f111dbd66'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.313793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] The token cache is being invalidate because project 7edd94a1732d4a018426e8b55d0eeda7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:31.314179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.314787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.319805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 809/1608] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:31 2021] DELETE /identity/v3/projects/7edd94a1732d4a018426e8b55d0eeda7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:31.396552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:31.402226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:31.403003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:31.403003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:31.407900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.532330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:31.534375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:31.572566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 800/1609] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:31 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:31.614755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:31.616817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.769866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:31.772036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.801780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606c512-6922-4034-b420-3d1f111dbd66 tempest-VolumeQuotaClassesTest-733591472 tempest-VolumeQuotaClassesTest-733591472-project-admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:31.819650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:31.820840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:31.821249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:31.821637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] PATH_INFO: `/v3/projects/fc526af9a596432792174a3cf4c232cb` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:31.823005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc526af9a596432792174a3cf4c232cb)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:31.825260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:31.870594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2e5f5-2363-40bd-961c-cabd34ded9a9 service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:31.878579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:31.881454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:31.882210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:31.882852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:31.886497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.904652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:31.907241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:31.935340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 801/1610] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:31.952479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc526af9a596432792174a3cf4c232cb', 'request_id': 'req-29bfe9f4-1d8b-479c-ab85-71ea6597d830'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.959045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:31.960766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:31.973113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc526af9a596432792174a3cf4c232cb', 'request_id': 'req-29bfe9f4-1d8b-479c-ab85-71ea6597d830'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:31.984098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53d55d-eb97-4d20-ba4e-6e2e897c14a8 service placement] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:31.999270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc526af9a596432792174a3cf4c232cb', 'request_id': 'req-29bfe9f4-1d8b-479c-ab85-71ea6597d830'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.037412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] The token cache is being invalidate because project fc526af9a596432792174a3cf4c232cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:32.037552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.038218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.040541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 810/1611] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:31 2021] DELETE /identity/v3/projects/fc526af9a596432792174a3cf4c232cb => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:32.044581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:32.051688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:32.106418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:32.106418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.106418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.106418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] PATH_INFO: `/v3/users/d6804d4b04ac46cea0bb163161891f49` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.107594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6804d4b04ac46cea0bb163161891f49)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:32.113218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:32.208301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6804d4b04ac46cea0bb163161891f49'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.235319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6804d4b04ac46cea0bb163161891f49'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.236492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6804d4b04ac46cea0bb163161891f49'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.252711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bfe9f4-1d8b-479c-ab85-71ea6597d830 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:32.266932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6804d4b04ac46cea0bb163161891f49'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.267337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:32.268450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.268898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.269337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] PATH_INFO: `/v3/users/e14d6ca7272e4404afa2af26f6e31d6a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.271877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14d6ca7272e4404afa2af26f6e31d6a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:32.273079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: WARNING py.warnings [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:56:32.273079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: warnings.warn(msg) Nov 09 04:56:32.273079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: Nov 09 04:56:32.274627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:32.284497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0967250c-2e61-4841-8a16-5fd293cb1465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6804d4b04ac46cea0bb163161891f49'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.301921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 802/1612] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:31 2021] DELETE /identity/v3/users/d6804d4b04ac46cea0bb163161891f49 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:32.310110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.310508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.311102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.352976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:32.354440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:32.392136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14d6ca7272e4404afa2af26f6e31d6a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.451430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14d6ca7272e4404afa2af26f6e31d6a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.462779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14d6ca7272e4404afa2af26f6e31d6a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.464018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14d6ca7272e4404afa2af26f6e31d6a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.491111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-47f6b85f-1274-47d7-a56a-0e2cb16af119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14d6ca7272e4404afa2af26f6e31d6a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:32.539162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 803/1613] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:32.550879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:32.553979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 811/1614] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:32 2021] DELETE /identity/v3/users/e14d6ca7272e4404afa2af26f6e31d6a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:32.554518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:32.616220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9c8a-3374-45c1-8970-24547b3e8bac None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.616504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9c8a-3374-45c1-8970-24547b3e8bac None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.617199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca9c8a-3374-45c1-8970-24547b3e8bac None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.619134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 812/1615] 10.222.0.41 () {54 vars in 912 bytes} [Tue Nov 9 04:56:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 09 04:56:32.624955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236775-8635-4668-ac8f-6f365c809848 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.625475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236775-8635-4668-ac8f-6f365c809848 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.625914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af236775-8635-4668-ac8f-6f365c809848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.653702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8173e-ddb8-470d-a739-469aeca9cf75 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:32.674505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-af236775-8635-4668-ac8f-6f365c809848 None None] MFA Rules not processed for user `91a0c407ceb84296be75ad28880f64cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:32.678016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-af236775-8635-4668-ac8f-6f365c809848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:32.743798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74dad0-f85f-47ff-a3bd-c274f211669d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:32.744470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74dad0-f85f-47ff-a3bd-c274f211669d service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.744895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74dad0-f85f-47ff-a3bd-c274f211669d service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.745173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74dad0-f85f-47ff-a3bd-c274f211669d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.800960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 813/1616] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:56:32 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:32.839742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236775-8635-4668-ac8f-6f365c809848 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:32.841970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-af236775-8635-4668-ac8f-6f365c809848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:32.856899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af236775-8635-4668-ac8f-6f365c809848 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:32.860954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:32.861794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:32.862068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:32.862344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:32.867064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74dad0-f85f-47ff-a3bd-c274f211669d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:32.869697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74dad0-f85f-47ff-a3bd-c274f211669d service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:32.871903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:32.885538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:32.912848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 814/1617] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:32 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:32.917833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 804/1618] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:56:33.679568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:33.681912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:33.708116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783434f-3cbc-4bec-aa74-5c592596e85c service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:33.719585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:33.720782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:33.721070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:33.721409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] PATH_INFO: `/v3/users/1b9f550ad685434a833bb9cce5089d6e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:33.724441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9f550ad685434a833bb9cce5089d6e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:33.726560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:33.859503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9f550ad685434a833bb9cce5089d6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:33.888023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9f550ad685434a833bb9cce5089d6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:33.903183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9f550ad685434a833bb9cce5089d6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:33.906037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9f550ad685434a833bb9cce5089d6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:33.922797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9f550ad685434a833bb9cce5089d6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:33.956270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 815/1619] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:33 2021] DELETE /identity/v3/users/1b9f550ad685434a833bb9cce5089d6e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:33.961200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:33.961800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:33.961800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:33.992108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:33.993335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:34.106582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 805/1620] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:34.131395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:34.133182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:34.266744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:34.268509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:34.287486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111c7ac-9dc7-4a0c-9294-900b91b7d744 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:34.299690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab245e-106b-4088-b513-4ff6eee60fe1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:34.299807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:34.299807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.299807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.300068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] PATH_INFO: `/v3/projects/041d2562b8034579b9f26165bfe13762` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.306022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041d2562b8034579b9f26165bfe13762)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:34.306837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb2bc2-e936-429f-ba63-e9fb28a9bbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:34.307008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: WARNING py.warnings [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 09 04:56:34.307008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: warnings.warn(msg) Nov 09 04:56:34.307008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: Nov 09 04:56:34.307522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2bc2-e936-429f-ba63-e9fb28a9bbee service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.308866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2bc2-e936-429f-ba63-e9fb28a9bbee service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.309158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb2bc2-e936-429f-ba63-e9fb28a9bbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.310737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:34.333434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2bc2-e936-429f-ba63-e9fb28a9bbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:34.336132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb2bc2-e936-429f-ba63-e9fb28a9bbee service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:34.353378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 816/1621] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:34.424038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041d2562b8034579b9f26165bfe13762', 'request_id': 'req-1282e40e-f0fd-43de-8277-7d2e8f28d644'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:34.444142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041d2562b8034579b9f26165bfe13762', 'request_id': 'req-1282e40e-f0fd-43de-8277-7d2e8f28d644'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:34.456598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041d2562b8034579b9f26165bfe13762', 'request_id': 'req-1282e40e-f0fd-43de-8277-7d2e8f28d644'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:34.505007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] The token cache is being invalidate because project 041d2562b8034579b9f26165bfe13762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:34.505415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:34.507374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:34.509895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 806/1622] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:34 2021] DELETE /identity/v3/projects/041d2562b8034579b9f26165bfe13762 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:34.517957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467279-49f9-4640-9d0d-696a8a99ed27 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.518549 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467279-49f9-4640-9d0d-696a8a99ed27 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.519436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88467279-49f9-4640-9d0d-696a8a99ed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.578371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-88467279-49f9-4640-9d0d-696a8a99ed27 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:34.580537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-88467279-49f9-4640-9d0d-696a8a99ed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:34.711472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:34.712958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:34.765767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 817/1623] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:34.767483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.768050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.768389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.816736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:34.818702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:34.840238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 818/1624] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:34.844459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:34.859952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3bfb3b-8689-44f3-976a-328cf043f723 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:34.866406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:34.867298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.867951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.868164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.868411 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1282e40e-f0fd-43de-8277-7d2e8f28d644 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:34.868927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:34.869239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:34.874897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:34.876457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:34.891474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.891815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.892100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] PATH_INFO: `/v3/projects/eb9dcad090d247508d51df3c835b3ab6` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.894249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9dcad090d247508d51df3c835b3ab6)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:34.898048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:34.900454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 819/1625] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:56:34.907459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:34.934757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcb202-3838-4a89-8bb4-3120766ca093 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:34.952111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:34.954049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:34.954049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:34.954049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:34.954429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:34.956404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:35.013820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 820/1626] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:34 2021] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:35.014296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9dcad090d247508d51df3c835b3ab6', 'request_id': 'req-456329b2-e3fe-46aa-b040-344992b3f8f9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.014936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:35.026855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9dcad090d247508d51df3c835b3ab6', 'request_id': 'req-456329b2-e3fe-46aa-b040-344992b3f8f9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.040494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9dcad090d247508d51df3c835b3ab6', 'request_id': 'req-456329b2-e3fe-46aa-b040-344992b3f8f9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.063555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] The token cache is being invalidate because project eb9dcad090d247508d51df3c835b3ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:35.063889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.064675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.070531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 807/1627] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:34 2021] DELETE /identity/v3/projects/eb9dcad090d247508d51df3c835b3ab6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:35.081427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:35.087441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:35.138900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3840d-254b-464c-9d7d-a444dc114a8d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:35.155779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:35.156637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:35.156929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:35.157215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:35.158086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:35.160402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:35.208991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 821/1628] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:35 2021] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:35.210272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:35.212127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:35.246457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ab46-6aba-4c97-b7be-804bc6ef6998 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:35.269791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:35.270537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:35.270828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:35.271113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:35.273659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:35.275338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:35.292746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456329b2-e3fe-46aa-b040-344992b3f8f9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:35.313231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:35.314882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:35.314882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:35.314882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] PATH_INFO: `/v3/users/47430fca72c44b4ba630ebca747bde91` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:35.320336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 822/1629] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:35 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:35.320973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=47430fca72c44b4ba630ebca747bde91)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:35.323817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:35.330537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:35.366669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbef8c6-11cc-4afa-9cd7-cadfbc210f7d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:35.390969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:35.391401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:35.392515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:35.392964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:35.393606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:35.402139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:35.462819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 823/1630] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:35 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:35.467739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:35.502723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47430fca72c44b4ba630ebca747bde91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.506214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d729a-6d17-41b7-b744-2859704016ad admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:35.516636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:35.518729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47430fca72c44b4ba630ebca747bde91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.520658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47430fca72c44b4ba630ebca747bde91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.522026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:35.522300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:35.523551 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] PATH_INFO: `/v3/projects/b7217e4e15c149fd9053ad651fe8d204/users/3eefa593104a4796a94adfc3a076d1cb/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:35.550392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47430fca72c44b4ba630ebca747bde91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.571314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7217e4e15c149fd9053ad651fe8d204, user_id=3eefa593104a4796a94adfc3a076d1cb, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:35.581230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:35.583649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bc4c17da-e431-4048-b92e-73da70b94bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47430fca72c44b4ba630ebca747bde91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:35.606061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 808/1631] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:35 2021] DELETE /identity/v3/users/47430fca72c44b4ba630ebca747bde91 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:35.621165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 824/1632] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:35 2021] PUT /identity/v3/projects/b7217e4e15c149fd9053ad651fe8d204/users/3eefa593104a4796a94adfc3a076d1cb/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:35.633368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:35.633561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:35.634001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:35.728747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] MFA Rules not processed for user `3eefa593104a4796a94adfc3a076d1cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:35.730518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:35.878827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 809/1633] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:35 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:35.879393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:35.881898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:36.020369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0f5b0-451b-457a-bb5e-a71f8b607c21 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.026251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.027839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.028978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.028978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.029649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.032022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:36.070444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 825/1634] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:35 2021] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:36.070674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:36.090012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1566102-6a43-47f7-a825-9c899cbb3e89 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.197610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.198480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.198864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.199207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.200023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.203320 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:36.259862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 810/1635] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:36 2021] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:36.264639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:36.286966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0104ee-b2f7-4f47-9f3f-8009ea3ea9a0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.292642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.293344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.293637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.294126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.295054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.297701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:36.333648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 826/1636] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:36 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:36.337569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:36.363984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15566c-91c6-4ce3-8b52-3332d0eb680d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.372507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.374124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.374651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.375132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] PATH_INFO: `/v3/projects/c139d277353f4ebfaf17ccd5a07eb460/users/6efa1e72fbd94e25b99ccb8c8bc40f1e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.421677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c139d277353f4ebfaf17ccd5a07eb460, user_id=6efa1e72fbd94e25b99ccb8c8bc40f1e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.424444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:36.463976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 811/1637] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:36 2021] PUT /identity/v3/projects/c139d277353f4ebfaf17ccd5a07eb460/users/6efa1e72fbd94e25b99ccb8c8bc40f1e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:36.468512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:36.488339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976b68f-b48b-47f7-89e3-930f57f9fc0a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.613496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.614511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.614920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.615200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.616179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.617829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:36.630257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 827/1638] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:36 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:36.634414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:36.650030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6f790-3479-43ec-9302-c0da4701c4ee admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.667450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a4ddb-9030-4db4-8597-046b2956343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.668399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a4ddb-9030-4db4-8597-046b2956343c admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.668678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a4ddb-9030-4db4-8597-046b2956343c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.669184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a4ddb-9030-4db4-8597-046b2956343c admin admin] PATH_INFO: `/v3/projects/c139d277353f4ebfaf17ccd5a07eb460/users/6efa1e72fbd94e25b99ccb8c8bc40f1e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.676207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a4ddb-9030-4db4-8597-046b2956343c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c139d277353f4ebfaf17ccd5a07eb460, user_id=6efa1e72fbd94e25b99ccb8c8bc40f1e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.679918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a4ddb-9030-4db4-8597-046b2956343c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:36.714897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 812/1639] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:36 2021] PUT /identity/v3/projects/c139d277353f4ebfaf17ccd5a07eb460/users/6efa1e72fbd94e25b99ccb8c8bc40f1e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:36.740716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:36.747396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:36.782864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.783759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.785181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef774a7-e7da-48d8-bf4d-330acbf3b692 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:36.785725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.874139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] MFA Rules not processed for user `6efa1e72fbd94e25b99ccb8c8bc40f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:36.875278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:36.944230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:36.945125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:36.945415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:36.945699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] PATH_INFO: `/v3/projects/6ca9c79d07d446299c631cb3712e3115` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:36.954190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca9c79d07d446299c631cb3712e3115)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:36.956168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.066794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca9c79d07d446299c631cb3712e3115', 'request_id': 'req-613d2cb8-9ad6-4188-aa05-d68e37af0002'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.074275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 813/1640] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:36 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:37.087870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca9c79d07d446299c631cb3712e3115', 'request_id': 'req-613d2cb8-9ad6-4188-aa05-d68e37af0002'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.095552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.099822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.112985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca9c79d07d446299c631cb3712e3115', 'request_id': 'req-613d2cb8-9ad6-4188-aa05-d68e37af0002'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.142122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] The token cache is being invalidate because project 6ca9c79d07d446299c631cb3712e3115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:37.142425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.145640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-613d2cb8-9ad6-4188-aa05-d68e37af0002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.154193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 828/1641] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:36 2021] DELETE /identity/v3/projects/6ca9c79d07d446299c631cb3712e3115 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:37.162053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671466-2f48-49d6-9b89-655060b74954 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.162719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671466-2f48-49d6-9b89-655060b74954 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.163207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671466-2f48-49d6-9b89-655060b74954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.202532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0a671466-2f48-49d6-9b89-655060b74954 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:37.207032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0a671466-2f48-49d6-9b89-655060b74954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.242597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed5b9c-d3f8-4ee2-9f4f-1d38bf7b8d92 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:37.324014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:37.324942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.325251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.325538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.328100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.344731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 829/1642] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:37.353187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.353484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.353960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.384104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:37.388067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.405034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 830/1643] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:37.409447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.427550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a8899-5631-46ba-9ea8-71e079a0396c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:37.437517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:37.438903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.439546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.440401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.441576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:37.442232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:37.445038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:37.447032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a34ba-ffa4-4626-89da-a4f6137a87d4 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.454870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.463687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 814/1644] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:37 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:37.465269 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.465846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.466289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.482290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 831/1645] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:37.489026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.518804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] MFA Rules not processed for user `115a975a272c4ad9a5e93a38ee1c8180`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:37.520285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.522718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d76b9f-cd82-409b-9547-e27181be5a06 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:37.532945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:37.534119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.534392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.534815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.535400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:37.537376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.587753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 832/1646] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:37.588676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.590376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.609566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 815/1647] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:37.610525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.611886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.623586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635a68c-d368-45fa-bf3b-82a6e386f21b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:37.653819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd97712-7cd9-4b13-8a08-63f829958c9e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:37.659429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:37.660486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.660780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.661063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] PATH_INFO: `/v3/projects/64b4caba45de4fe3b8899f3d515875f6` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.662267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b4caba45de4fe3b8899f3d515875f6)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:37.664214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.671942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:37.673360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.673651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.673930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.675799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.716481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b4caba45de4fe3b8899f3d515875f6', 'request_id': 'req-228c0769-ad92-4dfc-81a9-028c7271f721'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.725902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b4caba45de4fe3b8899f3d515875f6', 'request_id': 'req-228c0769-ad92-4dfc-81a9-028c7271f721'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.733178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b4caba45de4fe3b8899f3d515875f6', 'request_id': 'req-228c0769-ad92-4dfc-81a9-028c7271f721'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.742296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:37.743598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] The token cache is being invalidate because project 64b4caba45de4fe3b8899f3d515875f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:37.743911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a3348-5826-49ca-831c-40130f699066 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.744022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.744573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:37.746327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 833/1648] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:37 2021] DELETE /identity/v3/projects/64b4caba45de4fe3b8899f3d515875f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:37.747080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.749299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.756110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 816/1649] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:37 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:37.757586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895c9eb-bafd-4693-93ed-db9dce0097e2 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.757889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895c9eb-bafd-4693-93ed-db9dce0097e2 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.758192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895c9eb-bafd-4693-93ed-db9dce0097e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.788147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f895c9eb-bafd-4693-93ed-db9dce0097e2 None None] MFA Rules not processed for user `d77e7d6b09ac482f8bf1bcf4c83ed05e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:37.791332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f895c9eb-bafd-4693-93ed-db9dce0097e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.851559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c0769-ad92-4dfc-81a9-028c7271f721 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:37.862122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:37.863033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.863439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.863876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.864823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:37.867179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:37.897819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 834/1650] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:37.899311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.902342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.918857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 817/1651] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:37.918857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:37.918857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:37.918857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:37.961982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:37.963600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:37.973401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 818/1652] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:37.974659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:37.995679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e902ae-b84d-4aae-a082-19d6bfd3feb2 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.006216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a05cd-7c4e-4545-8ad9-642fe3512888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.006905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a05cd-7c4e-4545-8ad9-642fe3512888 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.007330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a05cd-7c4e-4545-8ad9-642fe3512888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.007948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a05cd-7c4e-4545-8ad9-642fe3512888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.008556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a05cd-7c4e-4545-8ad9-642fe3512888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.010032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a05cd-7c4e-4545-8ad9-642fe3512888 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.025340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 819/1653] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:37 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:38.025340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e243-f4c3-4b4d-8b19-0bc18e6aeba2 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.025340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e243-f4c3-4b4d-8b19-0bc18e6aeba2 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.025340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121e243-f4c3-4b4d-8b19-0bc18e6aeba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.055059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2121e243-f4c3-4b4d-8b19-0bc18e6aeba2 None None] MFA Rules not processed for user `d77e7d6b09ac482f8bf1bcf4c83ed05e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:38.056706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2121e243-f4c3-4b4d-8b19-0bc18e6aeba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:38.065970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 820/1654] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:38.067959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.068356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.069638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.087428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:38.088821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:38.091933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b549662-28fb-41b7-a33e-7e6d9163be1b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.097962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 821/1655] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:38.098868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.100369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.101853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.102148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.102837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.104648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:38.109267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27e1a9-2e03-41a6-8852-16502f5534e6 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.114517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.116814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.116814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.116814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.116814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.118246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.129427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 822/1656] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:38.133651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.135477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:38.151323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8e08a-2444-4a6a-9c64-da96c1f28b76 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.159472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.160742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.161181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.162351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.171976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.173989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.180683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.183472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.184456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 823/1657] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:38 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:38.185308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.195300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 835/1658] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:37 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:38.196086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7a4f-51e2-4d33-a767-49de3261bfd9 service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.201369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.202649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.203383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.203383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.203958 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:38.204262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.205830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.208741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.222381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 824/1659] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:38.223797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.234633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de48d3d0-1fdb-4045-a7a5-77b7a3c043bc admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.235448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa01f-ced6-494d-b144-161f954c5047 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.241336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.242273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.242742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.243218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.244171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.248903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe0f47-44a0-4f05-a997-b78433f2a51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.249886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0f47-44a0-4f05-a997-b78433f2a51a admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.250226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0f47-44a0-4f05-a997-b78433f2a51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.250453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe0f47-44a0-4f05-a997-b78433f2a51a admin admin] PATH_INFO: `/v3/projects/ec805a31f573404ca709fcd326f13a63/users/41761c267bb24343aca1c7f38c2dfcb3/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.259094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.289375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe0f47-44a0-4f05-a997-b78433f2a51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec805a31f573404ca709fcd326f13a63, user_id=41761c267bb24343aca1c7f38c2dfcb3, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.294433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe0f47-44a0-4f05-a997-b78433f2a51a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.310009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 825/1660] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:38.318303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.330419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 836/1661] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:38 2021] PUT /identity/v3/projects/ec805a31f573404ca709fcd326f13a63/users/41761c267bb24343aca1c7f38c2dfcb3/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:38.333579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.334461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.334855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.395981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] MFA Rules not processed for user `41761c267bb24343aca1c7f38c2dfcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:38.396846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:38.452036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b5ac3-3324-43ce-92b3-1df9077b1c7b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.532092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 837/1662] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:38.537222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.578924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.579635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.579926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.580207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.581081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.582864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.624820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 826/1663] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:38.629015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.655299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9a587-7a80-4c54-933e-567a5e553cb8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.667104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.669405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.671279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.671898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.672712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292048f4-4646-4a90-ba5a-b0eab096291b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.674319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.679167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.694721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.696356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.696645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.697479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.700353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.708744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 827/1664] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:38 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:38.708950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.710004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.734935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ae285-302b-464b-ac1c-0195062f1191 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.745362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.747478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.748082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.748909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.751519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:38.754239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:38.772797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 838/1665] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/projects => generated 405 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:38.777539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.781776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 828/1666] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:38 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:38.787068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:38.805213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b3000-ac78-482f-97bc-966976555bce admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:38.976478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:38.977450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:38.977883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:38.978172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] PATH_INFO: `/v3/projects/27a83687c28b4c5da666d55ad5806192/users/479274cbb0be4b9ea280351d21790a41/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:38.988404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07e25-696c-4ff1-98eb-cc3db85333e2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:39.014398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23b5fa-5e36-4309-82c3-7e32c9f72eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:39.015108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23b5fa-5e36-4309-82c3-7e32c9f72eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.015407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23b5fa-5e36-4309-82c3-7e32c9f72eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.015714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23b5fa-5e36-4309-82c3-7e32c9f72eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.016773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23b5fa-5e36-4309-82c3-7e32c9f72eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.017847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a83687c28b4c5da666d55ad5806192, user_id=479274cbb0be4b9ea280351d21790a41, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.018729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23b5fa-5e36-4309-82c3-7e32c9f72eb3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.022368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.086341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 829/1667] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:38 2021] PUT /identity/v3/projects/27a83687c28b4c5da666d55ad5806192/users/479274cbb0be4b9ea280351d21790a41/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:39.086902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 839/1668] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:38 2021] POST /identity/v3/users => generated 309 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:39.086986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:39.153527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.154090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.154090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.244626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] MFA Rules not processed for user `479274cbb0be4b9ea280351d21790a41`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:39.245866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:39.335171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1735d-f031-40a9-8346-1fc75fe4a60c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:39.356341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:39.357043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.359224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.359550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.360393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.365684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.384956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 830/1669] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:39 2021] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:39.390580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:39.413981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7111d6-918e-4d7d-89a4-9d8ec8d17424 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:39.426288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:39.427214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.427500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.427810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] PATH_INFO: `/v3/projects/646a37564266494b910b5a2c2112d5f1/users/8f9e7ea8ee48451ea76db1673014e427/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.449602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 840/1670] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:39 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:39.451217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:39.472001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=646a37564266494b910b5a2c2112d5f1, user_id=8f9e7ea8ee48451ea76db1673014e427, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.476986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea95a2-6a1a-4378-804e-fb7ad67eb7cc None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:39.480199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.490474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:39.494226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.494567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.494810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.501363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.503852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.524873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 831/1671] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:39 2021] PUT /identity/v3/projects/646a37564266494b910b5a2c2112d5f1/users/8f9e7ea8ee48451ea76db1673014e427/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:39.527777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:39.586105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 841/1672] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:39 2021] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:39.590902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:39.728736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005aec32-cc19-4a22-9194-65ad50dfaa3f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:39.799098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6852fe0a-e868-4af8-9aab-2aaedabcc429 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:39.813616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b14ee-db44-4c59-9b62-4e5e57a93c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:39.814361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b14ee-db44-4c59-9b62-4e5e57a93c6c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.815800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b14ee-db44-4c59-9b62-4e5e57a93c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.817622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b14ee-db44-4c59-9b62-4e5e57a93c6c admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.819119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b14ee-db44-4c59-9b62-4e5e57a93c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.823725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b14ee-db44-4c59-9b62-4e5e57a93c6c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.887295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 842/1673] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:39 2021] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:39.896570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec8a17-d360-43e2-a627-6c18b5b83f77 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.896792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec8a17-d360-43e2-a627-6c18b5b83f77 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.897070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ec8a17-d360-43e2-a627-6c18b5b83f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.952263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:39.954748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:39.954999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:39.955342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:39.957071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:39.961903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:39.996095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 832/1674] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:39 2021] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:39.997047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:40.028352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2973f65-8827-471e-85bb-d145eaa260e2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:40.038612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:40.039590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:40.040198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:40.041540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:40.044879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:40.047129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:40.059574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 833/1675] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:39 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:40.061504 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:40.063979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-31ec8a17-d360-43e2-a627-6c18b5b83f77 None None] MFA Rules not processed for user `d77e7d6b09ac482f8bf1bcf4c83ed05e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:40.072649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b92d7-78d3-4eb9-a4b1-7078991dfd07 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:40.078229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:40.078952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-31ec8a17-d360-43e2-a627-6c18b5b83f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:40.079183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:40.079472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:40.079787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] PATH_INFO: `/v3/projects/646a37564266494b910b5a2c2112d5f1/users/8f9e7ea8ee48451ea76db1673014e427/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:40.082007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=646a37564266494b910b5a2c2112d5f1, user_id=8f9e7ea8ee48451ea76db1673014e427, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:40.085162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:40.110792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 834/1676] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:40 2021] PUT /identity/v3/projects/646a37564266494b910b5a2c2112d5f1/users/8f9e7ea8ee48451ea76db1673014e427/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:40.111907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:40.442441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 843/1677] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 554 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:40.448957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:40.449973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:40.451643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:40.478393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9cb9e0-4b01-41ee-b6e3-bd532b6d4508 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:40.506904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380cc9-a988-4993-abf4-be111440f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:40.509863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380cc9-a988-4993-abf4-be111440f50d admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:40.510414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380cc9-a988-4993-abf4-be111440f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:40.511250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380cc9-a988-4993-abf4-be111440f50d admin admin] PATH_INFO: `/v3/projects/573afe76b05849978fa967fd28da7dd4/users/cc341ae017f648adae7d9b2389a974df/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:40.581648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380cc9-a988-4993-abf4-be111440f50d admin admin] RBAC: Authorizing `identity:create_grant(project_id=573afe76b05849978fa967fd28da7dd4, user_id=cc341ae017f648adae7d9b2389a974df, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:40.608751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] MFA Rules not processed for user `8f9e7ea8ee48451ea76db1673014e427`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:40.611235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380cc9-a988-4993-abf4-be111440f50d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:40.618614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:40.693335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 835/1678] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:40 2021] PUT /identity/v3/projects/573afe76b05849978fa967fd28da7dd4/users/cc341ae017f648adae7d9b2389a974df/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:40.699223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:40.703232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:40.704071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:40.786739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:40.793249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:40.951812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 844/1679] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:40 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 508 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:40.957385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:40.993211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c544-0075-4bfa-bd7d-3b6880ca9898 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:41.033354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 836/1680] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:56:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:41.034343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:41.048126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:41.146791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:41.148751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:41.149052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:41.151911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:41.152724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:41.154412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:41.187658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 845/1681] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:41.202275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:41.240214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64a419-b0bf-4c68-8a45-0d91ef433d93 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:41.253136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642dea6-6088-4da6-bf51-054d7f4613cc None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:41.259493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca1fb6f-7862-4442-a5dc-462236df0993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:41.260448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1fb6f-7862-4442-a5dc-462236df0993 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:41.260737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1fb6f-7862-4442-a5dc-462236df0993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:41.261136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca1fb6f-7862-4442-a5dc-462236df0993 admin admin] PATH_INFO: `/v3/projects/573afe76b05849978fa967fd28da7dd4/users/cc341ae017f648adae7d9b2389a974df/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:41.266702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1fb6f-7862-4442-a5dc-462236df0993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573afe76b05849978fa967fd28da7dd4, user_id=cc341ae017f648adae7d9b2389a974df, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:41.279565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca1fb6f-7862-4442-a5dc-462236df0993 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:41.280758 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:41.292877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:41.293496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:41.293796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:41.308291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 846/1682] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:41 2021] PUT /identity/v3/projects/573afe76b05849978fa967fd28da7dd4/users/cc341ae017f648adae7d9b2389a974df/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:41.321246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:41.321538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:41.321995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:41.391504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] MFA Rules not processed for user `cc341ae017f648adae7d9b2389a974df`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:41.392728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:41.483772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:41.485259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:41.527155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 837/1683] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:41 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:41.528549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:41.535113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:41.653558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 847/1684] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:41 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:41.767246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17aac7-836b-43d1-a525-1394c55b5d20 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:41.822427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:41.939371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:41.942340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:41.943030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:41.945078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:42.065982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660937b8-41d6-4821-bc84-81c6cc099e7e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:42.071686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:42.072715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:42.073209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:42.073692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:42.085483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:42.087393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:42.114698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 848/1685] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:41 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:42.163552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:42.164565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:42.188228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 838/1686] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:56:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:56:42.664957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:42.944289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198e59c-6acb-4d2e-a79b-ca715858fcd8 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:42.965975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:42.966830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:42.967115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:42.969001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] PATH_INFO: `/v3/users/41761c267bb24343aca1c7f38c2dfcb3` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:42.983306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] RBAC: Authorizing `identity:delete_user(user_id=41761c267bb24343aca1c7f38c2dfcb3)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:42.986434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:43.119798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:43.134782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb94489-082f-4bdb-9106-a5a5eadc4c5c service swift] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:43.161649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dd17a-055c-43dc-9eb7-d11d649eb78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:43.166951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41761c267bb24343aca1c7f38c2dfcb3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:43.167923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dd17a-055c-43dc-9eb7-d11d649eb78d service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:43.171977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dd17a-055c-43dc-9eb7-d11d649eb78d service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:43.174854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dd17a-055c-43dc-9eb7-d11d649eb78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:43.188012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41761c267bb24343aca1c7f38c2dfcb3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:43.189455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41761c267bb24343aca1c7f38c2dfcb3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:43.196069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41761c267bb24343aca1c7f38c2dfcb3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:43.245775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fddced9d-f6f5-4aba-a50d-b33c0a961eda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41761c267bb24343aca1c7f38c2dfcb3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:43.291291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 849/1687] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:42 2021] DELETE /identity/v3/users/41761c267bb24343aca1c7f38c2dfcb3 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:43.296407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:43.300087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:43.300592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:43.368991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:43.370011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dd17a-055c-43dc-9eb7-d11d649eb78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:43.372596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dd17a-055c-43dc-9eb7-d11d649eb78d service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:43.376793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:43.395512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 839/1688] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:43 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:43.492569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:43.492867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:43.493154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:43.566130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] MFA Rules not processed for user `91a0c407ceb84296be75ad28880f64cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:43.567384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:43.648544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 850/1689] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:43.736453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 840/1690] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Nov 9 04:56:43 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:43.764837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:43.767256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:43.800687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8f854-437a-47f2-b4a6-65923a8629ee None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:43.825582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e21305-8645-4ae8-b0b9-8c91335f9364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:43.826795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e21305-8645-4ae8-b0b9-8c91335f9364 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:43.827089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e21305-8645-4ae8-b0b9-8c91335f9364 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:43.827372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e21305-8645-4ae8-b0b9-8c91335f9364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:43.847690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e21305-8645-4ae8-b0b9-8c91335f9364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:43.848598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e21305-8645-4ae8-b0b9-8c91335f9364 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:43.866808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 851/1691] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:45.342384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:45.343977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:45.360293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ccba6-86a6-46fd-9cd8-fe0edd67f72c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:45.365170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:45.366161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:45.366480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:45.367603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] PATH_INFO: `/v3/projects/ec805a31f573404ca709fcd326f13a63` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:45.369025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec805a31f573404ca709fcd326f13a63)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:45.371154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:45.384448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:45.385341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:45.385878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:45.409114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] MFA Rules not processed for user `115a975a272c4ad9a5e93a38ee1c8180`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:45.410330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:45.423059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec805a31f573404ca709fcd326f13a63', 'request_id': 'req-360385c6-9450-47b5-8a46-27f3c50377b2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.430448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec805a31f573404ca709fcd326f13a63', 'request_id': 'req-360385c6-9450-47b5-8a46-27f3c50377b2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.439100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec805a31f573404ca709fcd326f13a63', 'request_id': 'req-360385c6-9450-47b5-8a46-27f3c50377b2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.451653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] The token cache is being invalidate because project ec805a31f573404ca709fcd326f13a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:45.452049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.452826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.454453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 841/1692] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:45 2021] DELETE /identity/v3/projects/ec805a31f573404ca709fcd326f13a63 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:45.458553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:45.459948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:45.470496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 852/1693] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:45 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:45.531742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360385c6-9450-47b5-8a46-27f3c50377b2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:45.536537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:45.537399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:45.539565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:45.539906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] PATH_INFO: `/v3/users/8f9e7ea8ee48451ea76db1673014e427` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:45.541188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f9e7ea8ee48451ea76db1673014e427)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:45.543115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:45.589348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f9e7ea8ee48451ea76db1673014e427'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.598009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f9e7ea8ee48451ea76db1673014e427'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.598930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f9e7ea8ee48451ea76db1673014e427'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.613044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f9e7ea8ee48451ea76db1673014e427'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.621179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c1020e32-e535-46c7-91d4-4d939c2508a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f9e7ea8ee48451ea76db1673014e427'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:45.631032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 842/1694] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:45 2021] DELETE /identity/v3/users/8f9e7ea8ee48451ea76db1673014e427 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:46.091105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.110161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2b59-95f6-4edc-83d2-31a1e58dd59d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.226783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.227674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.227967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.228249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] PATH_INFO: `/v3/projects/646a37564266494b910b5a2c2112d5f1` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.232987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] RBAC: Authorizing `identity:delete_project(project_id=646a37564266494b910b5a2c2112d5f1)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.234946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.309869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646a37564266494b910b5a2c2112d5f1', 'request_id': 'req-0223dc1f-c0de-4d08-90c7-511f0f43515b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:46.318045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646a37564266494b910b5a2c2112d5f1', 'request_id': 'req-0223dc1f-c0de-4d08-90c7-511f0f43515b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:46.324463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646a37564266494b910b5a2c2112d5f1', 'request_id': 'req-0223dc1f-c0de-4d08-90c7-511f0f43515b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:46.334898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] The token cache is being invalidate because project 646a37564266494b910b5a2c2112d5f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:46.335189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:46.335856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0223dc1f-c0de-4d08-90c7-511f0f43515b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:46.337383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 853/1695] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:46 2021] DELETE /identity/v3/projects/646a37564266494b910b5a2c2112d5f1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:46.343343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.343778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.343942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.361878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:46.363254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:46.428568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 843/1696] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:46.437052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.437509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.437673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.457358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:46.458562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:46.467323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 854/1697] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:46.471478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.481646 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5370551-388b-4470-a62d-ab0c8bf8d82e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.486396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.487170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.487457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.487763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.488502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:46.488801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.490615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.502291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 844/1698] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:46.506627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.516302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d86ca2-13e9-401f-86d2-925d202aafc1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.521327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.522324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.522793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.523253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.524371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.526507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.558561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 855/1699] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:46 2021] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:46.562656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.573885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e6b71-53d4-4325-892d-d5a55f38ee78 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.634887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.635563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.635879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.636157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.636868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.638803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.658730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 845/1700] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:46 2021] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:46.664193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.677189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941d49-3c8c-4dd5-b01e-d1f45ab2cc98 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.681902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.682565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.682856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.683153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.683924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.685582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.697493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 856/1701] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:46.702196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.712387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdd769-4530-415a-b549-2f121078677c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.717918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50910ab4-5aba-4521-afe5-ea2ef29ab043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.718584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50910ab4-5aba-4521-afe5-ea2ef29ab043 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.718861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50910ab4-5aba-4521-afe5-ea2ef29ab043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.719131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50910ab4-5aba-4521-afe5-ea2ef29ab043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.719917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50910ab4-5aba-4521-afe5-ea2ef29ab043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.721522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50910ab4-5aba-4521-afe5-ea2ef29ab043 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.731996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 846/1702] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:46.736274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.746721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceca8a-a4b8-4692-b8f3-6367a7b39ae0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.751492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.752503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.752847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.753184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] PATH_INFO: `/v3/projects/e14a547b64fc4bc5b06347583684e4f4/users/5a3110a8ff3d467da735ae4ce43ab90f/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.769065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14a547b64fc4bc5b06347583684e4f4, user_id=5a3110a8ff3d467da735ae4ce43ab90f, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.771801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:46.786607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 857/1703] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:46 2021] PUT /identity/v3/projects/e14a547b64fc4bc5b06347583684e4f4/users/5a3110a8ff3d467da735ae4ce43ab90f/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:46.796523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.796815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.797096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.823688 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] MFA Rules not processed for user `5a3110a8ff3d467da735ae4ce43ab90f`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:46.824886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:46.895768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 847/1704] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:46 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:46.897219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:46.967221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d8e60-6f28-4192-8791-053749df6453 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:46.972247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:46.973247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:46.973563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:46.973852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:46.974586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:46.976672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.007849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 858/1705] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:46 2021] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:47.008923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.019390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1dc44-af8f-48dd-919c-a78a26f97536 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.074686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.075373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.075678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.076095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.076819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.078757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.099035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 848/1706] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:47 2021] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:47.103280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.113801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba9f99-58d1-4ead-b9c7-8f110cf48603 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.118488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.119205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.119446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.119761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.120506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.122081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.133218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 859/1707] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:47.136976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.146629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909895e-1f03-47c7-891b-62aa083919e1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.151154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.152141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.152426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.152703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] PATH_INFO: `/v3/projects/7fb24945744a4c14814c46c9e594a93b/users/a631d41b55264e3eae7c2341858efd3c/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.167695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb24945744a4c14814c46c9e594a93b, user_id=a631d41b55264e3eae7c2341858efd3c, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.170955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.184339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 849/1708] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:47 2021] PUT /identity/v3/projects/7fb24945744a4c14814c46c9e594a93b/users/a631d41b55264e3eae7c2341858efd3c/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:47.188381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.197902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd954a-1dba-40d1-8bb6-65b5ceb2336b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.262828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33954e60-0160-41b5-8ed9-3db6e9759514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.269065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954e60-0160-41b5-8ed9-3db6e9759514 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.269634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954e60-0160-41b5-8ed9-3db6e9759514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.270222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33954e60-0160-41b5-8ed9-3db6e9759514 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.271003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33954e60-0160-41b5-8ed9-3db6e9759514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.272679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33954e60-0160-41b5-8ed9-3db6e9759514 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.289537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 860/1709] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:56:47.293977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.308175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96068c63-182c-4675-9b21-9e9bff69232f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.314485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.315434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.315804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.316081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] PATH_INFO: `/v3/projects/7fb24945744a4c14814c46c9e594a93b/users/a631d41b55264e3eae7c2341858efd3c/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.318148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb24945744a4c14814c46c9e594a93b, user_id=a631d41b55264e3eae7c2341858efd3c, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.321535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.334451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 850/1710] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:47 2021] PUT /identity/v3/projects/7fb24945744a4c14814c46c9e594a93b/users/a631d41b55264e3eae7c2341858efd3c/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:47.348378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.348378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.348378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.375895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] MFA Rules not processed for user `a631d41b55264e3eae7c2341858efd3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:47.377174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:47.443050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 861/1711] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:47 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:47.459360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.461156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:47.518273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717c317-4996-4132-8990-598ddcaccec6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.521817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.522450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.522734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.523011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.532458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.534134 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.543192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 851/1712] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:47 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:47.589353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:47.590738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:47.602784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f507-5105-499e-a7ce-cad259b354ad None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:47.606317 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadb40c-e7fb-4b21-874a-902a860edd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:47.606976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadb40c-e7fb-4b21-874a-902a860edd7c service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:47.607265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadb40c-e7fb-4b21-874a-902a860edd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:47.607545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadb40c-e7fb-4b21-874a-902a860edd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:47.660917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadb40c-e7fb-4b21-874a-902a860edd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:47.662268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadb40c-e7fb-4b21-874a-902a860edd7c service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:47.670813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 862/1713] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:47 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:51.936291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:51.938986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:52.117938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698bb1db-e810-490b-bf48-970a77b7719f service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:52.130447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:52.130447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:52.130447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:52.130447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] PATH_INFO: `/v3/users/479274cbb0be4b9ea280351d21790a41` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:52.130901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479274cbb0be4b9ea280351d21790a41)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:52.130901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:52.230468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479274cbb0be4b9ea280351d21790a41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.242436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479274cbb0be4b9ea280351d21790a41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.253509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479274cbb0be4b9ea280351d21790a41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.269266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479274cbb0be4b9ea280351d21790a41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.276877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479274cbb0be4b9ea280351d21790a41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.283693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 852/1714] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:51 2021] DELETE /identity/v3/users/479274cbb0be4b9ea280351d21790a41 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:52.288280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:52.288791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:52.288881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:52.315784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:52.317240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:52.392179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 863/1715] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:52.402333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:52.403888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:52.486665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31cf04-6b16-4b33-95db-de4db6fd3a61 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:52.490989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:52.491836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:52.492189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:52.492573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:52.502447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:52.503927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:52.513683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 853/1716] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:52.815846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:52.817260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:52.829943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4575f2b-63c0-4a0d-be91-5fe47f46d191 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:52.842429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:52.844352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:52.844798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:52.845128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] PATH_INFO: `/v3/projects/27a83687c28b4c5da666d55ad5806192` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:52.846341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a83687c28b4c5da666d55ad5806192)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:52.848670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:52.943378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a83687c28b4c5da666d55ad5806192', 'request_id': 'req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.959688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a83687c28b4c5da666d55ad5806192', 'request_id': 'req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.975792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a83687c28b4c5da666d55ad5806192', 'request_id': 'req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.994508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] The token cache is being invalidate because project 27a83687c28b4c5da666d55ad5806192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:52.994846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.995601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:52.997669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 864/1717] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:52 2021] DELETE /identity/v3/projects/27a83687c28b4c5da666d55ad5806192 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:53.001855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:53.014763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcb0f0-3c07-47b9-b3a6-a03b1a6b3b2e service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:53.122655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:53.123788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:53.125354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:53.125786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] PATH_INFO: `/v3/users/cc341ae017f648adae7d9b2389a974df` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:53.127198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc341ae017f648adae7d9b2389a974df)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:53.129524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:53.215843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc341ae017f648adae7d9b2389a974df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:53.231827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc341ae017f648adae7d9b2389a974df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:53.234459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc341ae017f648adae7d9b2389a974df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:53.263842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc341ae017f648adae7d9b2389a974df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:53.280693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc341ae017f648adae7d9b2389a974df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:53.292361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 854/1718] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:53 2021] DELETE /identity/v3/users/cc341ae017f648adae7d9b2389a974df => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:53.816740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:53.819089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:53.830878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:53.837587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:53.876360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e7784-85a2-45e3-9ce7-b8bd759b8b73 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:53.931474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b73ca6-7ce0-4f47-ac2f-32b80b327d13 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:53.944012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:53.945796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:53.946231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:53.946563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] PATH_INFO: `/v3/users/5a3110a8ff3d467da735ae4ce43ab90f` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:53.949289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3110a8ff3d467da735ae4ce43ab90f)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:53.953532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:53.974102 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:53.980440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:53.981262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:53.981755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] PATH_INFO: `/v3/projects/573afe76b05849978fa967fd28da7dd4` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:53.984280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=573afe76b05849978fa967fd28da7dd4)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:53.988459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.056017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3110a8ff3d467da735ae4ce43ab90f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.060652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573afe76b05849978fa967fd28da7dd4', 'request_id': 'req-63b86221-3c90-40d4-b944-87958c5d10bf'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.068465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3110a8ff3d467da735ae4ce43ab90f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.069132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3110a8ff3d467da735ae4ce43ab90f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.070715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573afe76b05849978fa967fd28da7dd4', 'request_id': 'req-63b86221-3c90-40d4-b944-87958c5d10bf'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.078923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573afe76b05849978fa967fd28da7dd4', 'request_id': 'req-63b86221-3c90-40d4-b944-87958c5d10bf'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.109508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3110a8ff3d467da735ae4ce43ab90f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.111536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] The token cache is being invalidate because project 573afe76b05849978fa967fd28da7dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:54.111934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.112760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-63b86221-3c90-40d4-b944-87958c5d10bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.127184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 865/1719] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:53 2021] DELETE /identity/v3/projects/573afe76b05849978fa967fd28da7dd4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:54.127548 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-282c3c40-dd38-4bf7-b011-94f957e28f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3110a8ff3d467da735ae4ce43ab90f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:54.127687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60903d5-6696-4d62-84d8-49122f2f79c1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.127687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60903d5-6696-4d62-84d8-49122f2f79c1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.127687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60903d5-6696-4d62-84d8-49122f2f79c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.141495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 855/1720] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:53 2021] DELETE /identity/v3/users/5a3110a8ff3d467da735ae4ce43ab90f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:54.146554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.147676 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.149539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.153259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a60903d5-6696-4d62-84d8-49122f2f79c1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:54.154679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a60903d5-6696-4d62-84d8-49122f2f79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:54.180065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:54.185378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:54.298101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 866/1721] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:54.315675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.315675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.315675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.320349 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 856/1722] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:54.341469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.346007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:54.352062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:54.353261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:54.361746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 867/1723] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:54.365819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.376339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bfe8d-665b-4d66-925c-aa4db1ac9a3d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.380753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.381423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.382136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.382136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.382705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:54.383014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.384681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.399683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 868/1724] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:56:54.401483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.414475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf00037-a22d-47fb-a038-602981fa0d66 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.420996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.422072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.422506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.422900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185f059-58f1-4664-ba39-6e6d8b419c69 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.422998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.424075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.426508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.427126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.427224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.427424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.427734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.436546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.438520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.447945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 857/1725] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:54.461588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 869/1726] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:54 2021] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:54.465634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.476023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de293882-d9e9-4ae5-be96-990e259412dc service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.555385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.556182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.556538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.556889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.558001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.560344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.583833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 858/1727] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:54 2021] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:54.588278 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.620265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd30b9-314e-49d4-9b5c-ae69784c19f8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.626041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.626924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.627392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.627747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.628510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.630351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.676732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 870/1728] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:54 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:56:54.678379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.691633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aa2b5-191d-40c2-a9ae-8d5e53f9c0aa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.699816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d760c2-112f-4ad1-9cfe-464307b1e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.700635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d760c2-112f-4ad1-9cfe-464307b1e373 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.701863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d760c2-112f-4ad1-9cfe-464307b1e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.702167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d760c2-112f-4ad1-9cfe-464307b1e373 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.704129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d760c2-112f-4ad1-9cfe-464307b1e373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.706667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d760c2-112f-4ad1-9cfe-464307b1e373 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.752939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 859/1729] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:54 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:54.754151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.769577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda98060-e2b5-4d10-befa-cdf545b1fbbf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:54.777604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:54.778541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.779270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.779270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] PATH_INFO: `/v3/projects/d73f2254f9104664909cf45b388913ef/users/b08829ce43ce49a9b6cf2576a84259d4/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.796927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d73f2254f9104664909cf45b388913ef, user_id=b08829ce43ce49a9b6cf2576a84259d4, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:54.800614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:54.839757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 871/1730] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:54 2021] PUT /identity/v3/projects/d73f2254f9104664909cf45b388913ef/users/b08829ce43ce49a9b6cf2576a84259d4/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:54.845617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:54.845916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:54.846207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:54.865025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:54.866698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:54.920181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] MFA Rules not processed for user `b08829ce43ce49a9b6cf2576a84259d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:54.922182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.003581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9c4a5-d043-49f4-946c-a16fedb31424 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.009487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.010366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.018283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.019348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] PATH_INFO: `/v3/users/3eefa593104a4796a94adfc3a076d1cb` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.024322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eefa593104a4796a94adfc3a076d1cb)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.028543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.058819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 860/1731] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:54 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:55.059948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.061324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.079073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6bfbc-3673-4518-a30e-9cc2f93c5c78 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.087105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.088435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.088720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.088996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] PATH_INFO: `/v3/projects/e14a547b64fc4bc5b06347583684e4f4` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.090325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14a547b64fc4bc5b06347583684e4f4)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.093711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.181948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14a547b64fc4bc5b06347583684e4f4', 'request_id': 'req-41f0f977-f494-4ab9-958e-d5ce777f0c57'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.194402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14a547b64fc4bc5b06347583684e4f4', 'request_id': 'req-41f0f977-f494-4ab9-958e-d5ce777f0c57'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.196305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eefa593104a4796a94adfc3a076d1cb'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.210509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14a547b64fc4bc5b06347583684e4f4', 'request_id': 'req-41f0f977-f494-4ab9-958e-d5ce777f0c57'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.222907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eefa593104a4796a94adfc3a076d1cb'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.223699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eefa593104a4796a94adfc3a076d1cb'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.224307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eefa593104a4796a94adfc3a076d1cb'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.235301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] The token cache is being invalidate because project e14a547b64fc4bc5b06347583684e4f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:55.235683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.236422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.241378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 861/1732] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:55 2021] DELETE /identity/v3/projects/e14a547b64fc4bc5b06347583684e4f4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:55.242310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.242864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eefa593104a4796a94adfc3a076d1cb'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.243852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.265468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 872/1733] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:54 2021] DELETE /identity/v3/users/3eefa593104a4796a94adfc3a076d1cb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:55.267080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.271434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.364135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0f977-f494-4ab9-958e-d5ce777f0c57 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.378667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b511cb-71ad-4ab4-a984-a39367f2288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.381693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b511cb-71ad-4ab4-a984-a39367f2288d admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.382834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b511cb-71ad-4ab4-a984-a39367f2288d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.383302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b511cb-71ad-4ab4-a984-a39367f2288d admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.384062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b511cb-71ad-4ab4-a984-a39367f2288d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.385612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f55ffe-e003-439f-b5d7-458f647b33e6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.385992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b511cb-71ad-4ab4-a984-a39367f2288d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.395306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.397465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.398436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.399010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] PATH_INFO: `/v3/users/a631d41b55264e3eae7c2341858efd3c` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.400852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a631d41b55264e3eae7c2341858efd3c)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.403367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.439317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 862/1734] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:55 2021] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:55.443997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.444286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.444560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.474627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:55.476389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.504610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a631d41b55264e3eae7c2341858efd3c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.543281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a631d41b55264e3eae7c2341858efd3c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.544057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a631d41b55264e3eae7c2341858efd3c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.544865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a631d41b55264e3eae7c2341858efd3c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.553582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a631d41b55264e3eae7c2341858efd3c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:55.575439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 873/1735] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:55 2021] DELETE /identity/v3/users/a631d41b55264e3eae7c2341858efd3c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:55.576464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.578360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.614938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 863/1736] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:55.624926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.626610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:55.650250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a0a044-f59e-4b0f-bb29-7d8dba6cf50c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.656650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.657661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.659458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.659860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.660752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.662806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.695798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 874/1737] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:55 2021] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:55.699878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.705177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d557c7-a8cd-43af-8beb-209d758b5dc1 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.711780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f0930-b9fa-4526-ade7-1c7fbe5b9295 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.716743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.717970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.717970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.718688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.719509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.721168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.735376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 875/1738] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:55 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:55.736337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.747591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb0e19-bb05-47e6-8a99-3ff4b46238b8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.753061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.754015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.754314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.754739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] PATH_INFO: `/v3/projects/837c657688b549e3bd722b90ac230edd/users/9e0faedc402f40ffa995c1d788b2b409/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.775994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c657688b549e3bd722b90ac230edd, user_id=9e0faedc402f40ffa995c1d788b2b409, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.779509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.802834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.803838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 876/1739] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:55 2021] PUT /identity/v3/projects/837c657688b549e3bd722b90ac230edd/users/9e0faedc402f40ffa995c1d788b2b409/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:55.804239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.804535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.804901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.808676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.817896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.819576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.832971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 864/1740] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:56:55.884464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbc299-9391-40f3-8f14-80c561bed292 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.889384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b97af9-5a37-4ee1-8167-236b15a8c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.890649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97af9-5a37-4ee1-8167-236b15a8c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.890935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97af9-5a37-4ee1-8167-236b15a8c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.891214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b97af9-5a37-4ee1-8167-236b15a8c9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.892157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b97af9-5a37-4ee1-8167-236b15a8c9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.894035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b97af9-5a37-4ee1-8167-236b15a8c9cd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.904602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 877/1741] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:55 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:55.909037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:55.918899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dfb68-badb-4a84-8ec9-c8128e36b3fe service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:55.924369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:55.925281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.925569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.925843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] PATH_INFO: `/v3/projects/837c657688b549e3bd722b90ac230edd/users/9e0faedc402f40ffa995c1d788b2b409/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:55.927965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837c657688b549e3bd722b90ac230edd, user_id=9e0faedc402f40ffa995c1d788b2b409, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:55.930750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:55.944112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 865/1742] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:55 2021] PUT /identity/v3/projects/837c657688b549e3bd722b90ac230edd/users/9e0faedc402f40ffa995c1d788b2b409/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:55.954886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:55.955593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:55.956076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.005978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:56.008489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] MFA Rules not processed for user `9e0faedc402f40ffa995c1d788b2b409`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:56.008643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.010390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.190071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 878/1743] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:55 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:56.211481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:56.213233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.226081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd8a594-7483-407b-b53a-599141ae5500 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:56.238169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:56.239308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.239789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.240142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] PATH_INFO: `/v3/projects/7fb24945744a4c14814c46c9e594a93b` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.248288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb24945744a4c14814c46c9e594a93b)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:56.250941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:56.348221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363428f-68ca-42a6-a4b9-fed7446193e9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:56.364391 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb24945744a4c14814c46c9e594a93b', 'request_id': 'req-e95d2a35-6487-426f-88fb-319646481702'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.381679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb24945744a4c14814c46c9e594a93b', 'request_id': 'req-e95d2a35-6487-426f-88fb-319646481702'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.399521 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb24945744a4c14814c46c9e594a93b', 'request_id': 'req-e95d2a35-6487-426f-88fb-319646481702'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.416751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] The token cache is being invalidate because project 7fb24945744a4c14814c46c9e594a93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:56.417300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.418706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.427085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 866/1744] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:56 2021] DELETE /identity/v3/projects/7fb24945744a4c14814c46c9e594a93b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:56.428469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:56.430357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.466331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:56.467126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.467524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.467985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.473164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.527038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d2a35-6487-426f-88fb-319646481702 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:56.539858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:56.540866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.541230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.541515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] PATH_INFO: `/v3/projects/b7217e4e15c149fd9053ad651fe8d204` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.544297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7217e4e15c149fd9053ad651fe8d204)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:56.546920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:56.618671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:56.622211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351640ab-bd72-4028-810b-365130bdbedb service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:56.629333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7217e4e15c149fd9053ad651fe8d204', 'request_id': 'req-7cd32c22-d93a-4f90-bd82-712da869d3ad'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.636157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7217e4e15c149fd9053ad651fe8d204', 'request_id': 'req-7cd32c22-d93a-4f90-bd82-712da869d3ad'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.653655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 879/1745] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:56 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:56:56.655201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ea5d-8f74-4ec1-a7a1-c44314b396b7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.656506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7217e4e15c149fd9053ad651fe8d204', 'request_id': 'req-7cd32c22-d93a-4f90-bd82-712da869d3ad'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.659212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ea5d-8f74-4ec1-a7a1-c44314b396b7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.659612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ea5d-8f74-4ec1-a7a1-c44314b396b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.674021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] The token cache is being invalidate because project b7217e4e15c149fd9053ad651fe8d204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:56.674321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.674992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:56.677406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 867/1746] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:56 2021] DELETE /identity/v3/projects/b7217e4e15c149fd9053ad651fe8d204 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:56.686746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:56.691106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.700497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5ee7ea5d-8f74-4ec1-a7a1-c44314b396b7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:56.701754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5ee7ea5d-8f74-4ec1-a7a1-c44314b396b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.827070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 880/1747] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:56.836447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.836961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.837250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.859606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32c22-d93a-4f90-bd82-712da869d3ad admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:56.884793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:56.886503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.887043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.887557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] PATH_INFO: `/v3/users/6efa1e72fbd94e25b99ccb8c8bc40f1e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.890343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efa1e72fbd94e25b99ccb8c8bc40f1e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:56.895703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:56.901491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:56.910565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:56.926817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 881/1748] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:56.930844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:56.957675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e006b-904b-41b4-9b69-1eec3de355d6 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:56.972582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:56.973810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:56.974115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:56.974405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:56.975818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:56.976229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:56.978145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:56.996514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 882/1749] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:57.000952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.008850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efa1e72fbd94e25b99ccb8c8bc40f1e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.015902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7764-911a-4481-a33e-2236bf8b7c73 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.029132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efa1e72fbd94e25b99ccb8c8bc40f1e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.031613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efa1e72fbd94e25b99ccb8c8bc40f1e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.035518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.036864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.037504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.038231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.039604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.042209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.055759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efa1e72fbd94e25b99ccb8c8bc40f1e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.084224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efa1e72fbd94e25b99ccb8c8bc40f1e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.088483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 883/1750] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:57.092358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.094768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.100983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 868/1751] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:56 2021] DELETE /identity/v3/users/6efa1e72fbd94e25b99ccb8c8bc40f1e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:57.229357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bcb28-2a93-4ec3-8003-d9e29025c2be admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.355597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.356524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.356921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.357304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.358225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.365427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.411976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.412942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 884/1752] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/users => generated 290 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:57.426586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9be86b-815e-4aea-ac48-45e93a877bde admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.433867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.434585 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.434984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.435371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.436328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.438205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.450774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 869/1753] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:56:57.454969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.469354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef237c3-ea77-4b31-b464-570ef609c3f2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.478172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c73f9-0eab-41fb-8c01-9de6ef40e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.478869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c73f9-0eab-41fb-8c01-9de6ef40e049 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.479161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c73f9-0eab-41fb-8c01-9de6ef40e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.479445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c73f9-0eab-41fb-8c01-9de6ef40e049 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.480241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c73f9-0eab-41fb-8c01-9de6ef40e049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.482023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c73f9-0eab-41fb-8c01-9de6ef40e049 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.493877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 885/1754] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:57 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:57.497924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.517599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415cc3-849c-45d7-9465-3e7e17ceb640 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.532517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.533706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.533997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.534282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] PATH_INFO: `/v3/projects/a15ae19762664b3280bac6703249d78d/users/49b4916bc2f24966822ccc4aee848202/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.575964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a15ae19762664b3280bac6703249d78d, user_id=49b4916bc2f24966822ccc4aee848202, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.579193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.616943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 870/1755] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:57 2021] PUT /identity/v3/projects/a15ae19762664b3280bac6703249d78d/users/49b4916bc2f24966822ccc4aee848202/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:57.626807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.627425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.627762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.630834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.632368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.664706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] MFA Rules not processed for user `49b4916bc2f24966822ccc4aee848202`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:57.665938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.718842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db75465-25f6-4d86-9efe-359c76c9f553 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.723854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.725020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.725527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.725924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] PATH_INFO: `/v3/users/b08829ce43ce49a9b6cf2576a84259d4` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.728608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08829ce43ce49a9b6cf2576a84259d4)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.730548 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.746704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 886/1756] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:57.746704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.746704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.758847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb63e9-2bf9-40da-ac3f-36c7c603fa3b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.763684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.764624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.765571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.765904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] PATH_INFO: `/v3/projects/c139d277353f4ebfaf17ccd5a07eb460` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.767193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c139d277353f4ebfaf17ccd5a07eb460)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.769236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.793949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08829ce43ce49a9b6cf2576a84259d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.802423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08829ce43ce49a9b6cf2576a84259d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.803505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08829ce43ce49a9b6cf2576a84259d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.817985 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08829ce43ce49a9b6cf2576a84259d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.824097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c139d277353f4ebfaf17ccd5a07eb460', 'request_id': 'req-e8247cba-e716-41a9-8feb-377d9cfd7c27'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.825260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08829ce43ce49a9b6cf2576a84259d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.832550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 871/1757] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:57 2021] DELETE /identity/v3/users/b08829ce43ce49a9b6cf2576a84259d4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:57.832735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c139d277353f4ebfaf17ccd5a07eb460', 'request_id': 'req-e8247cba-e716-41a9-8feb-377d9cfd7c27'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.833815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.835137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.842583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c139d277353f4ebfaf17ccd5a07eb460', 'request_id': 'req-e8247cba-e716-41a9-8feb-377d9cfd7c27'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.859650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] The token cache is being invalidate because project c139d277353f4ebfaf17ccd5a07eb460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:57.859650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.859650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e8247cba-e716-41a9-8feb-377d9cfd7c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:57.859650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 887/1758] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:57 2021] DELETE /identity/v3/projects/c139d277353f4ebfaf17ccd5a07eb460 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:57.862252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.862853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.863316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.882176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:57.883370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.900622 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4790495-0a7d-41ab-a70e-d584d9aadcea admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.905966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204eaec-f0cb-4c81-9209-29e4603ccc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:57.906594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204eaec-f0cb-4c81-9209-29e4603ccc24 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.906879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204eaec-f0cb-4c81-9209-29e4603ccc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.907184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204eaec-f0cb-4c81-9209-29e4603ccc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.908177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204eaec-f0cb-4c81-9209-29e4603ccc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:57.910050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6204eaec-f0cb-4c81-9209-29e4603ccc24 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:57.934653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 872/1759] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:57.936149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:57.936457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:57.936756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:57.941788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 888/1760] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:57.942533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:57.943791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:57.956804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:57.957148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348777e9-dcaf-4dee-b2cb-2c402fdaec84 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:57.958017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.018833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cf14c-009f-4207-b93a-e81fbc2f9b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.019599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cf14c-009f-4207-b93a-e81fbc2f9b99 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.020075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cf14c-009f-4207-b93a-e81fbc2f9b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.020465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cf14c-009f-4207-b93a-e81fbc2f9b99 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.020844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 873/1761] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:58.021787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.023188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.024659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cf14c-009f-4207-b93a-e81fbc2f9b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.027183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cf14c-009f-4207-b93a-e81fbc2f9b99 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.053782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 889/1762] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:57 2021] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:58.056825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.057518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.057518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.078372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:58.079602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.089434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 890/1763] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:58.090279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.096279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6ae85-c602-4459-8f79-170024890c80 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.100493 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.100651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eee8e5-7a03-4893-9511-90ca332fafe3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.101153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.101446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.101846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.105812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.106635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.106930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.107210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.108041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.112262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.117220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.120036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.144582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 874/1764] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:58.154353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.154552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 891/1765] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:58.154552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.161361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7035d8-aaaa-4c93-9a64-9f60ed681731 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.166053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61f6ea-b3a7-4297-94c3-6c69904a6f0f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.167948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.168635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.168923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.169214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.170126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:58.171071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.172777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.173197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.174075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.174539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.174964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.175898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.177485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.185930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 875/1766] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:58.188884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 892/1767] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:58.192996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.193141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.204604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee96f1-4104-4333-a993-4a045cd0efbb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.205503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d245b-fc82-4e3e-a038-10640d6025e1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.210687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec59af3-7eb9-4cea-aa12-534ead1e2eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.211701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.211873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59af3-7eb9-4cea-aa12-534ead1e2eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.211973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59af3-7eb9-4cea-aa12-534ead1e2eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.212294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59af3-7eb9-4cea-aa12-534ead1e2eb1 admin admin] PATH_INFO: `/v3/projects/3abca6bdc46f4f968b5d4889e547e416/users/fa8cf191f2704cb3904be874322e434b/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.212673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.213413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.213718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.214599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.216746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.230856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec59af3-7eb9-4cea-aa12-534ead1e2eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abca6bdc46f4f968b5d4889e547e416, user_id=fa8cf191f2704cb3904be874322e434b, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.233959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec59af3-7eb9-4cea-aa12-534ead1e2eb1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.251681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 876/1768] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:58.252686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 893/1769] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:58 2021] PUT /identity/v3/projects/3abca6bdc46f4f968b5d4889e547e416/users/fa8cf191f2704cb3904be874322e434b/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:56:58.257179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.265557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.265898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.266196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.300613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] MFA Rules not processed for user `fa8cf191f2704cb3904be874322e434b`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:58.303837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.379424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25f1e7-f47b-46b8-8887-58dc8c9ae2bd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.394603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 894/1770] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:58.395489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.396577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.397273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.397563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.397842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.398557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.400531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.412279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eae278-2bb7-44e2-918a-24a1e435475d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.417724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.418677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.419185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.419679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.420473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.422730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.423187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 877/1771] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:58.428097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.441697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9752da-a8ee-4778-b96d-4804eba4dd6b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.458795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.459579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.460002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.460326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.461139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.464860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.472500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 895/1772] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:58.482129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.482440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 878/1773] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:56:58.483370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.503516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643ac6f-3bf3-467d-ac16-351d40fc3cca admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.572062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568eba4e-31b2-49db-9b72-1d83b3e0a814 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.578079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.578836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.579223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.579569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.580411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.582446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.585229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.585895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.586178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.586484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.587216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.589071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.600562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 879/1774] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:58.601395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.604786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.607767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 896/1775] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:58.609301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.618855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5b3f8-5cef-4efa-a0d9-9949b85190c6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.621671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23490ea9-0ca6-49e6-82fb-f6215a9670e2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.627399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.628213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.628356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.628627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.628909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] PATH_INFO: `/v3/projects/d09c15a3671b44e1b3016a8ae72ff39b/users/81e011cebcad45ddb88a3f716a3ba0b5/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.629663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.629969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.630224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] PATH_INFO: `/v3/projects/d73f2254f9104664909cf45b388913ef` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.631427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d73f2254f9104664909cf45b388913ef)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.633375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.646029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09c15a3671b44e1b3016a8ae72ff39b, user_id=81e011cebcad45ddb88a3f716a3ba0b5, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.648750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.663117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 897/1776] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:58 2021] PUT /identity/v3/projects/d09c15a3671b44e1b3016a8ae72ff39b/users/81e011cebcad45ddb88a3f716a3ba0b5/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:58.664008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.703261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd73f2254f9104664909cf45b388913ef', 'request_id': 'req-ae54b2bb-06e6-40e3-8f40-2731796210fb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.710503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd73f2254f9104664909cf45b388913ef', 'request_id': 'req-ae54b2bb-06e6-40e3-8f40-2731796210fb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.717275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd73f2254f9104664909cf45b388913ef', 'request_id': 'req-ae54b2bb-06e6-40e3-8f40-2731796210fb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.727746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] The token cache is being invalidate because project d73f2254f9104664909cf45b388913ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:58.728041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.728718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ae54b2bb-06e6-40e3-8f40-2731796210fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.730552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 880/1777] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:58 2021] DELETE /identity/v3/projects/d73f2254f9104664909cf45b388913ef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:58.731849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.732138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.732418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.751307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f1194-0e5c-40bb-8a52-6d605d2695fa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.761258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] MFA Rules not processed for user `81e011cebcad45ddb88a3f716a3ba0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:58.762631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.810731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.812437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.812761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.813014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.813830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.815491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.827659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 898/1778] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:58.827659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.829007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.844168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 881/1779] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:58.845323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.847160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.847973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b39ef3-310b-430f-9ad5-7b576b9cdf66 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.852781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.853668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.853957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.854233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] PATH_INFO: `/v3/users/9e0faedc402f40ffa995c1d788b2b409` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.855443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0faedc402f40ffa995c1d788b2b409)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.857426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.862168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d211dd7b-965e-47cd-b01a-279b2d8419f6 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:58.867367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:58.868282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:58.868557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:58.868827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] PATH_INFO: `/v3/projects/615f52caeb564bc09cf4267c4083cee3/users/180359cb339d4903aa94b655898a2f35/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:58.884543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615f52caeb564bc09cf4267c4083cee3, user_id=180359cb339d4903aa94b655898a2f35, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:58.887482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:58.902818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 882/1780] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:58 2021] PUT /identity/v3/projects/615f52caeb564bc09cf4267c4083cee3/users/180359cb339d4903aa94b655898a2f35/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:58.904474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.906771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.910093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0faedc402f40ffa995c1d788b2b409'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.921897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0faedc402f40ffa995c1d788b2b409'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.922691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0faedc402f40ffa995c1d788b2b409'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.923315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0faedc402f40ffa995c1d788b2b409'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.935285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0faedc402f40ffa995c1d788b2b409'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:58.947739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 899/1781] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:56:58 2021] DELETE /identity/v3/users/9e0faedc402f40ffa995c1d788b2b409 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:58.948592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:58.949830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:58.977941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea2ed3-1e63-4f4d-8b69-b730b3728444 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.015697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754a45f-8b15-40c7-a664-f0b94dd1ad92 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.021524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.022126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.023041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.023341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.024506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.026393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.037369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 900/1782] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:59.037557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.038143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.038428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.038708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.039456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.041350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.041672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.052347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb09dfad-e507-4db5-9c05-3e1eaf994087 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.057998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a82d7-a0d4-496c-97ff-11be8afbfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.058897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a82d7-a0d4-496c-97ff-11be8afbfb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.059198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a82d7-a0d4-496c-97ff-11be8afbfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.059483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a82d7-a0d4-496c-97ff-11be8afbfb48 admin admin] PATH_INFO: `/v3/projects/615f52caeb564bc09cf4267c4083cee3/users/180359cb339d4903aa94b655898a2f35/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.062208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a82d7-a0d4-496c-97ff-11be8afbfb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615f52caeb564bc09cf4267c4083cee3, user_id=180359cb339d4903aa94b655898a2f35, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.064901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a82d7-a0d4-496c-97ff-11be8afbfb48 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.071203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 883/1783] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:58 2021] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:56:59.074979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.077081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.080055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 901/1784] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:59 2021] PUT /identity/v3/projects/615f52caeb564bc09cf4267c4083cee3/users/180359cb339d4903aa94b655898a2f35/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:59.091146 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07379f06-e807-4a46-9731-2245d342f129 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.092039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07379f06-e807-4a46-9731-2245d342f129 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.092336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07379f06-e807-4a46-9731-2245d342f129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.130181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-07379f06-e807-4a46-9731-2245d342f129 None None] MFA Rules not processed for user `180359cb339d4903aa94b655898a2f35`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:59.132030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-07379f06-e807-4a46-9731-2245d342f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.153546 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4adfd8-4e2c-44e4-8d9e-9a5feb2cef1a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.214554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 902/1785] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:59 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:56:59.228660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.229407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.229782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.230130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.231037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.232306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07379f06-e807-4a46-9731-2245d342f129 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.233055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.237199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-07379f06-e807-4a46-9731-2245d342f129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.271794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 884/1786] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:56:59 2021] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:56:59.271794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.272760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.284781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea166a-c74c-4605-97f0-7055858b9200 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.289788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.290940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.291227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.291502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] PATH_INFO: `/v3/projects/837c657688b549e3bd722b90ac230edd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.292732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837c657688b549e3bd722b90ac230edd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.294630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.318214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07379f06-e807-4a46-9731-2245d342f129 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.322240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.323000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.323366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.323721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.333885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.335537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.345501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837c657688b549e3bd722b90ac230edd', 'request_id': 'req-168f232f-0e6a-4baa-9c7a-54b72721bf88'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:59.346914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 903/1787] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:59.347553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.352901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837c657688b549e3bd722b90ac230edd', 'request_id': 'req-168f232f-0e6a-4baa-9c7a-54b72721bf88'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:59.358256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb600-e3c9-4e41-9ef6-522fe5798dd7 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.369565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837c657688b549e3bd722b90ac230edd', 'request_id': 'req-168f232f-0e6a-4baa-9c7a-54b72721bf88'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:59.387392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] The token cache is being invalidate because project 837c657688b549e3bd722b90ac230edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:56:59.387730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:59.388398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:56:59.390027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 885/1788] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:56:59 2021] DELETE /identity/v3/projects/837c657688b549e3bd722b90ac230edd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:59.395429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.396933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.437443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.438184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.438473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.438750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.442617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.442617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.457994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 904/1789] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:59.457994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.458843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.472111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d19c2-8963-4fed-ba9b-ca222200fe8c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.473003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f232f-0e6a-4baa-9c7a-54b72721bf88 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.476212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.477063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.477403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.477690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.478594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.479565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.480052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.480476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.482807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.487326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.493668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.495106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03edd7-00cf-4ad0-a00e-58d943ccf173 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.498955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.501645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.512031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 886/1790] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:59.513138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 905/1791] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:59.513365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.513877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.514290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.514596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.515291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.530702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cd8b4-5915-4b27-b92a-827cb33a98af service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.537983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.538725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.539015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.539500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.542192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:59.543554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.550774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.552463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.553791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 887/1792] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:59.554633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.556097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.563659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 906/1793] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:56:59.565188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.567115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.586299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b16dcb-baef-45da-a064-2025f2fe6ecf service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.606575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a373150-82f9-42ca-a065-f66e6d0cd2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.609910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373150-82f9-42ca-a065-f66e6d0cd2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.610203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373150-82f9-42ca-a065-f66e6d0cd2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.610482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373150-82f9-42ca-a065-f66e6d0cd2ec admin admin] PATH_INFO: `/v3/projects/523f33b16f2342fe83ad74e46b963597/users/dc4807ff98eb424eacd855f77e075ed0/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.658861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a373150-82f9-42ca-a065-f66e6d0cd2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=523f33b16f2342fe83ad74e46b963597, user_id=dc4807ff98eb424eacd855f77e075ed0, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.666692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a373150-82f9-42ca-a065-f66e6d0cd2ec admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.688579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04576ad4-8354-4e5f-85b9-6499874bdea5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.695568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 907/1794] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:59 2021] PUT /identity/v3/projects/523f33b16f2342fe83ad74e46b963597/users/dc4807ff98eb424eacd855f77e075ed0/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:59.695568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3136b-dc5f-482a-931d-612152291005 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.695568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3136b-dc5f-482a-931d-612152291005 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.695568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3136b-dc5f-482a-931d-612152291005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.718383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-30d3136b-dc5f-482a-931d-612152291005 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:56:59.719744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-30d3136b-dc5f-482a-931d-612152291005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.833811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 908/1795] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:56:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:56:59.833811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3136b-dc5f-482a-931d-612152291005 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.850735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3136b-dc5f-482a-931d-612152291005 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.857457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.858144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.859029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.859338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.860166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.862138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.870423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.871103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.871388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.871695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.877446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 909/1796] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:56:59.877446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.877701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:56:59.889631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caec5d9-f8ce-4dac-ab3f-413605835370 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.894622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.895302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.895588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.895898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.896654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:56:59.897171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.899470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.917617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 910/1797] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:56:59.918482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:56:59.929424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412413-baff-4cbd-897b-f96ebd006055 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:56:59.934404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:56:59.936444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:56:59.936796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:56:59.937083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] PATH_INFO: `/v3/projects/523f33b16f2342fe83ad74e46b963597/users/dc4807ff98eb424eacd855f77e075ed0/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:56:59.939428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523f33b16f2342fe83ad74e46b963597, user_id=dc4807ff98eb424eacd855f77e075ed0, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:56:59.942094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:56:59.955425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 911/1798] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:56:59 2021] PUT /identity/v3/projects/523f33b16f2342fe83ad74e46b963597/users/dc4807ff98eb424eacd855f77e075ed0/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:56:59.956281 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:00.000621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.002498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6545c34-ddbb-474c-99e2-746706b50c55 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.012413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 888/1799] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:56:59 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:00.013817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.014195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.014554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.041473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397054ef-6a91-4b00-94af-6943943f81a8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:00.047384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:00.049486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.050009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.050495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.051613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.053883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.055972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] MFA Rules not processed for user `dc4807ff98eb424eacd855f77e075ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:00.057700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:00.111575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 912/1800] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:56:59 2021] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:00.112771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:00.177665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 889/1801] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:00 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:00.203133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:00.206051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:00.273503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd106-f43e-4114-93cb-04c4fde7651b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:00.274971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31331f-05b6-4172-b883-e9df10a657fc None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:00.285479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:00.286347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.287756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.288185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.289423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.293763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.339475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4d09c-0665-4816-987d-90f0f0139bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:00.340645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d09c-0665-4816-987d-90f0f0139bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.340993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d09c-0665-4816-987d-90f0f0139bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.341282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4d09c-0665-4816-987d-90f0f0139bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.352026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 913/1802] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:00 2021] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:00.354850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:00.377336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ab8bb-46de-4340-814a-26d8789c287b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:00.390770 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:00.391472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.391787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.392071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.392828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.400144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.426753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 914/1803] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:00 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:00.431522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:00.464068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a54d9-913e-4049-8966-0179b3e8b36d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:00.479327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:00.485193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.485193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.491972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.494916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.499400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4d09c-0665-4816-987d-90f0f0139bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.500922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4d09c-0665-4816-987d-90f0f0139bb9 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.502140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.527314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 915/1804] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:00 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:00.532236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:00.533402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 890/1805] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:00 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:00.555282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ead449-9a72-4b61-8af7-bb28ce9a81b2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:00.570610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:00.571537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.571879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.572161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] PATH_INFO: `/v3/projects/f87c221849fc4d01ab8f2e881e81ecc8/users/db8ffd42bed34a3a8a060d38976807bd/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.593754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87c221849fc4d01ab8f2e881e81ecc8, user_id=db8ffd42bed34a3a8a060d38976807bd, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:00.597483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:00.648283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 916/1806] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:00 2021] PUT /identity/v3/projects/f87c221849fc4d01ab8f2e881e81ecc8/users/db8ffd42bed34a3a8a060d38976807bd/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:00.651177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd814e12-7ea3-4b5d-9e67-5a2d3b359cc6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:00.651470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd814e12-7ea3-4b5d-9e67-5a2d3b359cc6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:00.654181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd814e12-7ea3-4b5d-9e67-5a2d3b359cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:00.702993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-dd814e12-7ea3-4b5d-9e67-5a2d3b359cc6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:00.707061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-dd814e12-7ea3-4b5d-9e67-5a2d3b359cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:00.847207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 891/1807] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:00.875157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:01.022176 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41910a-b544-4b2c-a80b-861cac9d67a6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:01.032893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484dd1a-b034-4bff-9439-083764ce809a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:01.034520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484dd1a-b034-4bff-9439-083764ce809a service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:01.034755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484dd1a-b034-4bff-9439-083764ce809a service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:01.035521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484dd1a-b034-4bff-9439-083764ce809a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:01.067905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484dd1a-b034-4bff-9439-083764ce809a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:01.072015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484dd1a-b034-4bff-9439-083764ce809a service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:01.097328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 917/1808] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:01.413928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e85d-1d44-4271-a9c3-a659b25022a7 None None] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:01.414245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e85d-1d44-4271-a9c3-a659b25022a7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:01.415423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64e85d-1d44-4271-a9c3-a659b25022a7 None None] PATH_INFO: `/` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:01.418640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 892/1809] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 04:57:01 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:57:01.457247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3038e5-b65e-4e56-9e7b-af1dd9c54137 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:01.457971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3038e5-b65e-4e56-9e7b-af1dd9c54137 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:01.458451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3038e5-b65e-4e56-9e7b-af1dd9c54137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:01.486720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ee3038e5-b65e-4e56-9e7b-af1dd9c54137 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:01.488933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ee3038e5-b65e-4e56-9e7b-af1dd9c54137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:01.592292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 918/1810] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 04:57:01 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:01.621426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64e85d-1d44-4271-a9c3-a659b25022a7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:01.623317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3b64e85d-1d44-4271-a9c3-a659b25022a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:01.645518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64e85d-1d44-4271-a9c3-a659b25022a7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:01.652847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38225bc2-1ceb-461d-b056-9b3527b21d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:01.653650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38225bc2-1ceb-461d-b056-9b3527b21d32 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:01.653933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38225bc2-1ceb-461d-b056-9b3527b21d32 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:01.654373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38225bc2-1ceb-461d-b056-9b3527b21d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:01.685345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38225bc2-1ceb-461d-b056-9b3527b21d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:01.687864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38225bc2-1ceb-461d-b056-9b3527b21d32 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:01.708357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 893/1811] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:02.026949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd0b0-2b21-47c0-b153-1c9686708660 None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:02.027352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd0b0-2b21-47c0-b153-1c9686708660 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:02.028405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd0b0-2b21-47c0-b153-1c9686708660 None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:02.033982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 919/1812] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 04:57:02 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:57:02.087118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:02.087413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:02.087717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:02.129632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:02.132079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:02.154105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 894/1813] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 04:57:02 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:02.264133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd0b0-2b21-47c0-b153-1c9686708660 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:02.290992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd0b0-2b21-47c0-b153-1c9686708660 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:02.311454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c972-fd1d-40a4-9d70-9049b158a8e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:02.313051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c972-fd1d-40a4-9d70-9049b158a8e6 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:02.313544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c972-fd1d-40a4-9d70-9049b158a8e6 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:02.316839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c972-fd1d-40a4-9d70-9049b158a8e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:02.336695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c972-fd1d-40a4-9d70-9049b158a8e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:02.339046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c972-fd1d-40a4-9d70-9049b158a8e6 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:02.354887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 920/1814] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:02.834002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:02.844666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7560a-ad56-4c5c-9367-f913bd8465f3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:02.851096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:02.852021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:02.852302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:02.852808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] PATH_INFO: `/v3/users/81e011cebcad45ddb88a3f716a3ba0b5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:02.854179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e011cebcad45ddb88a3f716a3ba0b5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:02.856329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:02.912690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e011cebcad45ddb88a3f716a3ba0b5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:02.923389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e011cebcad45ddb88a3f716a3ba0b5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:02.924717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e011cebcad45ddb88a3f716a3ba0b5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:02.944656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e011cebcad45ddb88a3f716a3ba0b5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:02.951386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e011cebcad45ddb88a3f716a3ba0b5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:02.959345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 895/1815] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:02 2021] DELETE /identity/v3/users/81e011cebcad45ddb88a3f716a3ba0b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:02.964298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:02.964762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:02.965196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:02.991587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:02.993075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:03.102119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 921/1816] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:03.153577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:03.155356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:03.236269 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f60e-6003-4670-bc0a-1c57daed5593 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:03.240858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ce599-7e8b-4022-8b1c-547eda112ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:03.241582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce599-7e8b-4022-8b1c-547eda112ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:03.242913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce599-7e8b-4022-8b1c-547eda112ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:03.243572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ce599-7e8b-4022-8b1c-547eda112ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:03.256121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ce599-7e8b-4022-8b1c-547eda112ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:03.257909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ce599-7e8b-4022-8b1c-547eda112ec6 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:03.271596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 896/1817] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:03.668499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:03.671025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:03.688810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99849cd8-3dfb-43a8-97d4-bcc0995b0fcd None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:03.697667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:03.702869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:03.703451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:03.704100 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] PATH_INFO: `/v3/users/49b4916bc2f24966822ccc4aee848202` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:03.706149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b4916bc2f24966822ccc4aee848202)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:03.709358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:03.796262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b4916bc2f24966822ccc4aee848202'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:03.820465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b4916bc2f24966822ccc4aee848202'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:03.821441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b4916bc2f24966822ccc4aee848202'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:03.822046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b4916bc2f24966822ccc4aee848202'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:03.836218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b4916bc2f24966822ccc4aee848202'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:03.855831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 922/1818] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:03 2021] DELETE /identity/v3/users/49b4916bc2f24966822ccc4aee848202 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:03.862345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d618f4-a859-470e-84c4-29b9dc7fdf2b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:03.862837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d618f4-a859-470e-84c4-29b9dc7fdf2b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:03.863669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d618f4-a859-470e-84c4-29b9dc7fdf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:03.883008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-00d618f4-a859-470e-84c4-29b9dc7fdf2b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:03.884303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-00d618f4-a859-470e-84c4-29b9dc7fdf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:03.995997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 897/1819] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:04.013697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:04.016203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:04.157823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffdbb4-f4eb-4bad-b235-2866f5ebcced admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:04.161762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:04.162524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:04.163476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:04.163871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:04.174505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:04.176093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:04.189407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 923/1820] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:04.805018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:04.805312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:04.805600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:04.873168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] MFA Rules not processed for user `db8ffd42bed34a3a8a060d38976807bd`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:04.876202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:04.953806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:04.955189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:04.977016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 898/1821] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:04 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:04.981939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:04.985095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:04.989853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc5331-701b-4440-bdb5-9e408e18fce0 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:04.998070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:04.999716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.000843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.001402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] PATH_INFO: `/v3/projects/d09c15a3671b44e1b3016a8ae72ff39b` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.006070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09c15a3671b44e1b3016a8ae72ff39b)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.008043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.018100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52d91c-086d-477c-b8bb-609ccd4cf8c9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.033318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.035862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.036920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.038136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.039159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.042409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.105444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09c15a3671b44e1b3016a8ae72ff39b', 'request_id': 'req-871afba5-9d40-43f3-a433-c8163df72085'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.112674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 899/1822] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:04 2021] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:05.116991 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.122895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09c15a3671b44e1b3016a8ae72ff39b', 'request_id': 'req-871afba5-9d40-43f3-a433-c8163df72085'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.143884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09c15a3671b44e1b3016a8ae72ff39b', 'request_id': 'req-871afba5-9d40-43f3-a433-c8163df72085'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.162757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] The token cache is being invalidate because project d09c15a3671b44e1b3016a8ae72ff39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:05.164622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.166024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.168707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 924/1823] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:04 2021] DELETE /identity/v3/projects/d09c15a3671b44e1b3016a8ae72ff39b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:05.174947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.177179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:05.268838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df665674-e433-403c-a22a-46dff6573c35 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.280962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.282398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.283091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.283502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.284367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.286731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.291255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afba5-9d40-43f3-a433-c8163df72085 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.303038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.304034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.304371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.304655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] PATH_INFO: `/v3/users/dc4807ff98eb424eacd855f77e075ed0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.306705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4807ff98eb424eacd855f77e075ed0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.312819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.334733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 900/1824] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:05 2021] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:05.336606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.345590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:05.367275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb476f0-6688-492f-920c-c4253ea743c5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.384405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.385137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.385518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.385973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] PATH_INFO: `/v3/projects/a15ae19762664b3280bac6703249d78d` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.388890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a15ae19762664b3280bac6703249d78d)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.391554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.426208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4807ff98eb424eacd855f77e075ed0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.455418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4807ff98eb424eacd855f77e075ed0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.456371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4807ff98eb424eacd855f77e075ed0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.457201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4807ff98eb424eacd855f77e075ed0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.464975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4807ff98eb424eacd855f77e075ed0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.478816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 925/1825] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:05 2021] DELETE /identity/v3/users/dc4807ff98eb424eacd855f77e075ed0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:05.482680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.484680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:05.515592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a15ae19762664b3280bac6703249d78d', 'request_id': 'req-8f849734-5b2a-4ec5-8030-b9f8b546aff6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.523464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a15ae19762664b3280bac6703249d78d', 'request_id': 'req-8f849734-5b2a-4ec5-8030-b9f8b546aff6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.555112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a15ae19762664b3280bac6703249d78d', 'request_id': 'req-8f849734-5b2a-4ec5-8030-b9f8b546aff6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.572068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] The token cache is being invalidate because project a15ae19762664b3280bac6703249d78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:05.572378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.573434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.575721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 901/1826] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:05 2021] DELETE /identity/v3/projects/a15ae19762664b3280bac6703249d78d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:05.580255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.582094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:05.602620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b01d4-7d89-4a42-a89e-d40d54e8801e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.608837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.609817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.610246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.610682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.611731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.614405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.628219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 926/1827] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:05.632874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.636348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:05.658706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f218702-d13f-42aa-8f5b-9cfe2a159d9f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.673940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.675163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849734-5b2a-4ec5-8030-b9f8b546aff6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.675418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.675943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.677488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] PATH_INFO: `/v3/projects/2d14db71de884cf3ac70961926420fe6/users/b96074fc45bf4d9794ac27e5c844e210/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.681233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.682122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.682459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.682749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] PATH_INFO: `/v3/users/fa8cf191f2704cb3904be874322e434b` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.684105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8cf191f2704cb3904be874322e434b)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.687808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.712068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d14db71de884cf3ac70961926420fe6, user_id=b96074fc45bf4d9794ac27e5c844e210, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.718723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.734368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 927/1828] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:05 2021] PUT /identity/v3/projects/2d14db71de884cf3ac70961926420fe6/users/b96074fc45bf4d9794ac27e5c844e210/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:05.739121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.777569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8cf191f2704cb3904be874322e434b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.793387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8cf191f2704cb3904be874322e434b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.794346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8cf191f2704cb3904be874322e434b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.818936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8cf191f2704cb3904be874322e434b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.819173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8369b-7f65-4c61-97e6-c14fd481652f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.826244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.826966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.827258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.827567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.828638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.829403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8cf191f2704cb3904be874322e434b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:05.830951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.840505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 902/1829] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:05 2021] DELETE /identity/v3/users/fa8cf191f2704cb3904be874322e434b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:05.845736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 928/1830] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:05 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:05.850101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:05.851490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:05.955060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4feee-9814-44dc-94e8-63ba222dba2c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:05.969006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:05.970487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:05.971126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:05.972927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] PATH_INFO: `/v3/projects/2d14db71de884cf3ac70961926420fe6/users/b96074fc45bf4d9794ac27e5c844e210/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:05.976722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d14db71de884cf3ac70961926420fe6, user_id=b96074fc45bf4d9794ac27e5c844e210, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:05.979886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:05.995450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 903/1831] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:05 2021] PUT /identity/v3/projects/2d14db71de884cf3ac70961926420fe6/users/b96074fc45bf4d9794ac27e5c844e210/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:06.255150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:06.257276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:06.277356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821165d9-0308-4d8d-860f-4a8528ff4730 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:06.422348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:06.424909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.425447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.426147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] PATH_INFO: `/v3/projects/523f33b16f2342fe83ad74e46b963597` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.427399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:06.428677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523f33b16f2342fe83ad74e46b963597)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:06.429321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:06.431205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:06.464910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5395c-1b1a-4d73-89b1-529878a5f2b5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:06.469807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:06.470613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.470897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.471174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] PATH_INFO: `/v3/projects/3abca6bdc46f4f968b5d4889e547e416` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.473513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abca6bdc46f4f968b5d4889e547e416)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:06.475797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:06.531009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523f33b16f2342fe83ad74e46b963597', 'request_id': 'req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.543607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523f33b16f2342fe83ad74e46b963597', 'request_id': 'req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.551562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523f33b16f2342fe83ad74e46b963597', 'request_id': 'req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.575945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] The token cache is being invalidate because project 523f33b16f2342fe83ad74e46b963597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:06.576386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.577812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2abed3cb-9cdf-4b52-a4b9-3446d6b6b657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.584386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 929/1832] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:06 2021] DELETE /identity/v3/projects/523f33b16f2342fe83ad74e46b963597 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:06.584541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abca6bdc46f4f968b5d4889e547e416', 'request_id': 'req-e71aae75-3cee-4ff9-af0d-dc98680966bd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.586315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11cdf8-b1ea-4f81-bb10-46908014678e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.586684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11cdf8-b1ea-4f81-bb10-46908014678e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.587047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11cdf8-b1ea-4f81-bb10-46908014678e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.592879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abca6bdc46f4f968b5d4889e547e416', 'request_id': 'req-e71aae75-3cee-4ff9-af0d-dc98680966bd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.611690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abca6bdc46f4f968b5d4889e547e416', 'request_id': 'req-e71aae75-3cee-4ff9-af0d-dc98680966bd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.629792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-fa11cdf8-b1ea-4f81-bb10-46908014678e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:06.631094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fa11cdf8-b1ea-4f81-bb10-46908014678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:06.644992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] The token cache is being invalidate because project 3abca6bdc46f4f968b5d4889e547e416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:06.645313 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.646061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.648212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 904/1833] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:06 2021] DELETE /identity/v3/projects/3abca6bdc46f4f968b5d4889e547e416 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:06.652706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:06.654363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:06.761823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 930/1834] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:06.762414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71aae75-3cee-4ff9-af0d-dc98680966bd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:06.763374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.763698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.763989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.768410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:06.769474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.770096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.770384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] PATH_INFO: `/v3/users/180359cb339d4903aa94b655898a2f35` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.771913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] RBAC: Authorizing `identity:delete_user(user_id=180359cb339d4903aa94b655898a2f35)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:06.774217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:06.787887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:06.789335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:06.803398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 931/1835] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:06.804743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:06.815603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f46402-a21f-43e4-9b39-460ec04adf61 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:06.820913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:06.821591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.821860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.822141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.822892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:06.823205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:06.824831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:06.837138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180359cb339d4903aa94b655898a2f35'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.838627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 932/1836] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:06.843606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:06.848570 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180359cb339d4903aa94b655898a2f35'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.850290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180359cb339d4903aa94b655898a2f35'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.854435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7691f416-aed2-43ba-ab77-b314c0ee16ca admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:06.860030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25698d05-407b-4992-9db2-773399767784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:06.860825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25698d05-407b-4992-9db2-773399767784 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:06.861211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25698d05-407b-4992-9db2-773399767784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:06.861592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25698d05-407b-4992-9db2-773399767784 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:06.862624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25698d05-407b-4992-9db2-773399767784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:06.864896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25698d05-407b-4992-9db2-773399767784 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:06.866650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180359cb339d4903aa94b655898a2f35'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.874613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180359cb339d4903aa94b655898a2f35'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:06.880993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 905/1837] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:06 2021] DELETE /identity/v3/users/180359cb339d4903aa94b655898a2f35 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:06.900701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:06.906142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:06.916182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 933/1838] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:06 2021] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:06.994177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a996d8-3297-4ee3-b670-b6a1f007298c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.057445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.058132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.058417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.058694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.059580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.062342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.104718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 906/1839] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:06 2021] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:07.105997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25698d05-407b-4992-9db2-773399767784 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.117271 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25698d05-407b-4992-9db2-773399767784 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.124082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.124797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.125081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.126241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.127167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.129166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.140668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 934/1840] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:07.145516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.156312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b679-465a-4e27-ac74-7cabf4d33d74 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.161853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b01206-f5ad-49c2-b192-e956ff0ad539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.162799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01206-f5ad-49c2-b192-e956ff0ad539 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.163083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01206-f5ad-49c2-b192-e956ff0ad539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.163574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b01206-f5ad-49c2-b192-e956ff0ad539 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.164538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01206-f5ad-49c2-b192-e956ff0ad539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.166135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b01206-f5ad-49c2-b192-e956ff0ad539 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.183559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 907/1841] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:07.189086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.211298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496794d-7c9d-4644-9c1f-a00897ee7ec2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.241746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff2b7b-97bd-40e0-99ba-f03b96f1a7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.242715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2b7b-97bd-40e0-99ba-f03b96f1a7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.243061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2b7b-97bd-40e0-99ba-f03b96f1a7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.243340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff2b7b-97bd-40e0-99ba-f03b96f1a7ec admin admin] PATH_INFO: `/v3/projects/919b6438334a4704b8eeefc0f5310810/users/80311ed7b71040eea91e2519b38bf8f0/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.264896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.265194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.265473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.273137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff2b7b-97bd-40e0-99ba-f03b96f1a7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=919b6438334a4704b8eeefc0f5310810, user_id=80311ed7b71040eea91e2519b38bf8f0, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.279515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff2b7b-97bd-40e0-99ba-f03b96f1a7ec admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.301164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 935/1842] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:07 2021] PUT /identity/v3/projects/919b6438334a4704b8eeefc0f5310810/users/80311ed7b71040eea91e2519b38bf8f0/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:07.308846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] MFA Rules not processed for user `b96074fc45bf4d9794ac27e5c844e210`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:07.311682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.311960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.312202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.312318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.348013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] MFA Rules not processed for user `80311ed7b71040eea91e2519b38bf8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:07.349313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.412812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 908/1843] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:07.414244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.416182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.479108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 936/1844] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:07.479108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.479362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.516624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95a589-9f5d-42ae-a2cb-c604cc7e4c61 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.521702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.522926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.523398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.523889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] PATH_INFO: `/v3/projects/615f52caeb564bc09cf4267c4083cee3` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.525822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=615f52caeb564bc09cf4267c4083cee3)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.528184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.542691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8f1d-6ccc-4818-96ea-95ed12b41a1c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.547633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.548330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.548640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.548923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.550883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.595809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615f52caeb564bc09cf4267c4083cee3', 'request_id': 'req-98a8ebea-a85e-4105-9327-07b61ae70567'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:07.603133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615f52caeb564bc09cf4267c4083cee3', 'request_id': 'req-98a8ebea-a85e-4105-9327-07b61ae70567'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:07.613402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615f52caeb564bc09cf4267c4083cee3', 'request_id': 'req-98a8ebea-a85e-4105-9327-07b61ae70567'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:07.618401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.619899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.627575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] The token cache is being invalidate because project 615f52caeb564bc09cf4267c4083cee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:07.628368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:07.629174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-98a8ebea-a85e-4105-9327-07b61ae70567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:07.629568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 937/1845] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:07 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:07.630389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.636308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 909/1846] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:07 2021] DELETE /identity/v3/projects/615f52caeb564bc09cf4267c4083cee3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:07.638166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eaf2d-9a98-4070-b5b7-b879ae852957 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.638540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eaf2d-9a98-4070-b5b7-b879ae852957 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.639197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6eaf2d-9a98-4070-b5b7-b879ae852957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.642619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d73a0f-d50f-4656-9b5f-37a3eaffdc89 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.664609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8c6eaf2d-9a98-4070-b5b7-b879ae852957 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:07.671427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8c6eaf2d-9a98-4070-b5b7-b879ae852957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.710707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.711382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.711695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.711981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.712697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.714607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.733261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 910/1847] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:07.743140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.743478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.743816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.745934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 938/1848] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:07.749748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.751400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.763663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:07.765472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:07.821062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c66ab0-77c7-4fd8-8963-1797c2ac886c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.825826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.826552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.827459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.827785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.828552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.830570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.835362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 911/1849] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:07.839495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.849324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8571d-6a2d-435c-929b-39a01186249b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.852776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 939/1850] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:07.856758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.857225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.857891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.858205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.858527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.859231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:07.859541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.861173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.866792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a406d-49f3-46f8-9120-9deadd2d2dfd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.873105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.873241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 912/1851] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:57:07.874210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.874488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.874834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.875673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.877555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.878019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.887849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899bbac-16ae-44fc-bc2c-23c76b1d4fed admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.892822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 940/1852] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:07.893558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.893783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.894446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.894731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.895010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.895747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.897706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.903399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b34d-d3c6-497a-8a7d-117c7e16fcdf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:07.909073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:07.909974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:07.910264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:07.910547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] PATH_INFO: `/v3/projects/8c535a829a2c42b78936018530cc1448/users/7645f42424c245f6b27597e52e98ee57/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:07.928474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c535a829a2c42b78936018530cc1448, user_id=7645f42424c245f6b27597e52e98ee57, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:07.931159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:07.932216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 913/1853] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:07.940920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:07.954446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 941/1854] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:07 2021] PUT /identity/v3/projects/8c535a829a2c42b78936018530cc1448/users/7645f42424c245f6b27597e52e98ee57/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:07.960963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.028287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee03305-95a3-42f5-9ef5-85e3f05a98fe admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.033945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.034634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.034928 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.035208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.035959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.038065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.039700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab669-2019-4b73-bb52-7a4bbf0d9eee admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.045047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.046217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.046217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.046552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.047381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.049077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.058965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 914/1855] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:07 2021] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:08.060495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 942/1856] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:07 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:08.065008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.065168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.074595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d236d-03de-477b-8a32-9c4853493479 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.075720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a7344-a1a6-4cd4-ad2b-abd7041e2da4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.080030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.080648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.080937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.081219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.081608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bfbd6-cc25-4862-bec5-882d3074e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.082337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.082620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bfbd6-cc25-4862-bec5-882d3074e889 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.082921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bfbd6-cc25-4862-bec5-882d3074e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.083206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bfbd6-cc25-4862-bec5-882d3074e889 admin admin] PATH_INFO: `/v3/projects/8c535a829a2c42b78936018530cc1448/users/7645f42424c245f6b27597e52e98ee57/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.083556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.085298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bfbd6-cc25-4862-bec5-882d3074e889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c535a829a2c42b78936018530cc1448, user_id=7645f42424c245f6b27597e52e98ee57, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.088111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bfbd6-cc25-4862-bec5-882d3074e889 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.099500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 915/1857] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:08.100824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.107541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 943/1858] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:08 2021] PUT /identity/v3/projects/8c535a829a2c42b78936018530cc1448/users/7645f42424c245f6b27597e52e98ee57/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:08.111837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17f9eb-2a54-451a-bc6d-b463b9a7807d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.117346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.117758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.118147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.146063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] MFA Rules not processed for user `7645f42424c245f6b27597e52e98ee57`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:08.147329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.169662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.170336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.170656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.171057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.171852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.173468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.182999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 916/1859] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:08.187797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.197136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692c03c-0845-4fd3-bcef-a0050be2204c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.202484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124e919-4ba8-4632-8b30-85024b5b10bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.203392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e919-4ba8-4632-8b30-85024b5b10bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.203720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e919-4ba8-4632-8b30-85024b5b10bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.204007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124e919-4ba8-4632-8b30-85024b5b10bf admin admin] PATH_INFO: `/v3/projects/c42a11fdf6254273b71e9f892d083b86/users/2c869e844b354acaa157e6ed7efebd34/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.214418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 944/1860] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:08 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:08.221543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124e919-4ba8-4632-8b30-85024b5b10bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42a11fdf6254273b71e9f892d083b86, user_id=2c869e844b354acaa157e6ed7efebd34, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.225440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124e919-4ba8-4632-8b30-85024b5b10bf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.226768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.228202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.239109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 917/1861] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:08 2021] PUT /identity/v3/projects/c42a11fdf6254273b71e9f892d083b86/users/2c869e844b354acaa157e6ed7efebd34/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:08.250824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.251051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.251339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.282427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] MFA Rules not processed for user `2c869e844b354acaa157e6ed7efebd34`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:08.283811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.325498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95818815-2332-4c61-ac81-bd215520ee20 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.371795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 918/1862] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:08 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:08.372937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.400298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.401247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.401533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.401811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.445481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543a507-bf00-497b-8477-5db756454cc5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.450163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.450826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.451112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.451393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.452184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.454094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.470523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.472290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.483675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 919/1863] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:08 2021] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:08.483811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 945/1864] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:08.486149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.559694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160c54e-bdfa-4885-8f6d-55ed827c9ef1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.566725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.567243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.567482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.567825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.568110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.568842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.570899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.581471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7af744-7845-4adf-b3a0-60d9ebd00cdf service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.587319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.588315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.588782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.589161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] PATH_INFO: `/v3/users/80311ed7b71040eea91e2519b38bf8f0` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.590513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80311ed7b71040eea91e2519b38bf8f0)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.592773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.593578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 920/1865] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:08 2021] POST /identity/v3/users => generated 298 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:08.597214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.607588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fb11a-270d-4960-ae60-fe0822328541 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.613437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.614251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.614588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.614941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.615798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.617478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.629055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 921/1866] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:08.634358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.645839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71bed6-3e58-41b2-9bfe-c2c8ba5b26a9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.651810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.653428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.653724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.654115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] PATH_INFO: `/v3/projects/bf5f426d9e5f43cc9178c42cb2930871/users/999b45131bf44523b9cef05edc6f518c/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.654728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80311ed7b71040eea91e2519b38bf8f0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:08.669652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5f426d9e5f43cc9178c42cb2930871, user_id=999b45131bf44523b9cef05edc6f518c, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.672434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.678304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80311ed7b71040eea91e2519b38bf8f0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:08.679203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80311ed7b71040eea91e2519b38bf8f0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:08.679903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80311ed7b71040eea91e2519b38bf8f0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:08.685832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 922/1867] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:08 2021] PUT /identity/v3/projects/bf5f426d9e5f43cc9178c42cb2930871/users/999b45131bf44523b9cef05edc6f518c/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:08.688652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c2bba5a9-abbe-4e0c-b0d9-e933a85584d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80311ed7b71040eea91e2519b38bf8f0'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:08.690200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.691992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.707140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 946/1868] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:08 2021] DELETE /identity/v3/users/80311ed7b71040eea91e2519b38bf8f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:08.713346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.713650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.713928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.736125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:08.737329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.765686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1ef64-1af0-4924-b516-43a8673ca0af admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.794113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 947/1869] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:08.803952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.805390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.819026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.819728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.820018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.820299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.821042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.822641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.836832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 923/1870] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:08.841094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.850807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e5900-01bc-497c-82c8-1c57d32909a5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.855376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d20d3c-bdaa-4c6c-9233-b504a593457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.856270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20d3c-bdaa-4c6c-9233-b504a593457c admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.856549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20d3c-bdaa-4c6c-9233-b504a593457c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.856820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d20d3c-bdaa-4c6c-9233-b504a593457c admin admin] PATH_INFO: `/v3/projects/bf5f426d9e5f43cc9178c42cb2930871/users/999b45131bf44523b9cef05edc6f518c/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.858801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d20d3c-bdaa-4c6c-9233-b504a593457c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf5f426d9e5f43cc9178c42cb2930871, user_id=999b45131bf44523b9cef05edc6f518c, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.861447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d20d3c-bdaa-4c6c-9233-b504a593457c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.861860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacb909-445d-48e8-85ec-0a5814411949 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:08.865515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:08.866160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.866449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.866732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.871649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 924/1871] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:08 2021] PUT /identity/v3/projects/bf5f426d9e5f43cc9178c42cb2930871/users/999b45131bf44523b9cef05edc6f518c/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:08.876330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:08.877794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:08.881718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:08.882017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:08.882298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:08.887869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 948/1872] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:08.908517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] MFA Rules not processed for user `999b45131bf44523b9cef05edc6f518c`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:08.909720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:08.980655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 925/1873] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:08 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:08.991050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:08.992491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:09.054496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c93a-2559-4ea8-9733-de9c83d1f55b service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:09.101435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:09.102083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:09.102367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:09.102645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:09.104739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:09.164508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:09.166032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:09.172850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:09.174323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:09.176790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 949/1874] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:08 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:09.252572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fa548-284c-4e1d-8404-b87697ca972b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:09.258536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:09.259614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:09.259986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:09.260405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] PATH_INFO: `/v3/projects/919b6438334a4704b8eeefc0f5310810` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:09.261711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] RBAC: Authorizing `identity:delete_project(project_id=919b6438334a4704b8eeefc0f5310810)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:09.263766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:09.318696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919b6438334a4704b8eeefc0f5310810', 'request_id': 'req-0e132dcc-97db-43f1-ac7d-40fe024112be'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.325306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919b6438334a4704b8eeefc0f5310810', 'request_id': 'req-0e132dcc-97db-43f1-ac7d-40fe024112be'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.333523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919b6438334a4704b8eeefc0f5310810', 'request_id': 'req-0e132dcc-97db-43f1-ac7d-40fe024112be'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.344389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] The token cache is being invalidate because project 919b6438334a4704b8eeefc0f5310810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:09.344684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.345321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.347124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 926/1875] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:09 2021] DELETE /identity/v3/projects/919b6438334a4704b8eeefc0f5310810 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:09.357311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:09.369069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4bb4f-00a7-40e8-8af8-8978cff37de9 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:09.429447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:09.430979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:09.431346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:09.431644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] PATH_INFO: `/v3/users/7645f42424c245f6b27597e52e98ee57` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:09.432937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7645f42424c245f6b27597e52e98ee57)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:09.435776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:09.526274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7645f42424c245f6b27597e52e98ee57'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.542898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7645f42424c245f6b27597e52e98ee57'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.543921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7645f42424c245f6b27597e52e98ee57'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.545088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7645f42424c245f6b27597e52e98ee57'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.572612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7da3b68e-8ad1-4996-850d-15c1a0b39f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7645f42424c245f6b27597e52e98ee57'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:09.586962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 950/1876] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:09 2021] DELETE /identity/v3/users/7645f42424c245f6b27597e52e98ee57 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:10.673620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:10.675145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:10.688947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e132dcc-97db-43f1-ac7d-40fe024112be admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:10.769387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:10.770636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:10.771111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:10.771673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] PATH_INFO: `/v3/projects/8c535a829a2c42b78936018530cc1448` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:10.773307 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c535a829a2c42b78936018530cc1448)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:10.775742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:10.847028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c535a829a2c42b78936018530cc1448', 'request_id': 'req-5d2df014-50cf-4677-844a-bbe9bc65bcf2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:10.856413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c535a829a2c42b78936018530cc1448', 'request_id': 'req-5d2df014-50cf-4677-844a-bbe9bc65bcf2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:10.866451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c535a829a2c42b78936018530cc1448', 'request_id': 'req-5d2df014-50cf-4677-844a-bbe9bc65bcf2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:10.879833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] The token cache is being invalidate because project 8c535a829a2c42b78936018530cc1448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:10.880123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:10.880936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-5d2df014-50cf-4677-844a-bbe9bc65bcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:10.882717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 927/1877] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:10 2021] DELETE /identity/v3/projects/8c535a829a2c42b78936018530cc1448 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:10.888169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:10.889980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:10.890275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:10.912944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:10.914058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:10.983683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 951/1878] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:10.988944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:10.989616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:10.990094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.010647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:11.012514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:11.026709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 928/1879] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:11.028687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.038468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4913d6e-1fbe-4924-ace0-0f2700a172d8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.043118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.044020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.044380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.044966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.047398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:11.047831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.049544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.072111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 952/1880] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:57:11.073281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.083485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7470e47-977b-45e1-9fd8-fc6e9c243f84 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.088575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.089617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.090090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.090547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.091449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.093782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.130695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.132367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:11.138428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 929/1881] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:11 2021] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:11.143219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.199184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec974-628e-4638-bb01-716d8de8b5cf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.213440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c064b-fc67-442b-9f8c-a073c303be01 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.220053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.220937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.221376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.221797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.222658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.225484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.248248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 930/1882] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:11 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:11.249513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.250213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.250511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.250795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.252393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.253029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:11.263171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268fb57-dd59-4d4e-87b6-2ec4d84e761f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.268697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.269402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.269687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.269983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.270717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.272357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.287342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 931/1883] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:11.288435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.299696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d93df0-4857-4f40-b54e-b71bd9d97c37 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.304240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.305023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.305313 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.305589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.306321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.308057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.322677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 932/1884] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:11 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:11.323663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.323857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.325563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d2a6-f4e4-4cdb-a961-dd2cceffe4c7 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.334885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36f672-f4a8-4810-a794-8ebdf08c3d6a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.337348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 953/1885] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:11 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:11.348476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.349498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.349672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.349911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] PATH_INFO: `/v3/projects/9208b28fe5234ffba294a46aecd6008b/users/9cd4b437827c49c39665532dda7c5d67/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.366198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9208b28fe5234ffba294a46aecd6008b, user_id=9cd4b437827c49c39665532dda7c5d67, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.368908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.386174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 933/1886] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:11 2021] PUT /identity/v3/projects/9208b28fe5234ffba294a46aecd6008b/users/9cd4b437827c49c39665532dda7c5d67/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:11.403256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a886-042a-4605-947f-e12aa291d4b0 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.403561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a886-042a-4605-947f-e12aa291d4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.403869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a886-042a-4605-947f-e12aa291d4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.440068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-36d7a886-042a-4605-947f-e12aa291d4b0 None None] MFA Rules not processed for user `9cd4b437827c49c39665532dda7c5d67`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:11.441263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-36d7a886-042a-4605-947f-e12aa291d4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:11.515280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 954/1887] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:11 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:11.529107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:11.531020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:11.615305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10419b2-b447-4927-b13e-c24c4aad83e3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:11.619237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab567c3-9379-40db-a9f0-e6ec59aaf995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:11.619948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab567c3-9379-40db-a9f0-e6ec59aaf995 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:11.620360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab567c3-9379-40db-a9f0-e6ec59aaf995 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:11.620645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab567c3-9379-40db-a9f0-e6ec59aaf995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:11.629691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab567c3-9379-40db-a9f0-e6ec59aaf995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:11.631518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab567c3-9379-40db-a9f0-e6ec59aaf995 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:11.641031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 934/1888] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:11 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:18.102125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27a87-1803-45a1-978f-20c31bf4e22e None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:18.103050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27a87-1803-45a1-978f-20c31bf4e22e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:18.104607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e27a87-1803-45a1-978f-20c31bf4e22e None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:18.109490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 955/1889] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 04:57:18 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 04:57:18.118248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:18.118775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:18.118775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:18.140522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] MFA Rules not processed for user `c16b11a1bbac45c0b869734149bd3416`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:18.142298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:18.226467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 935/1890] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 04:57:18 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:18.247883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27a87-1803-45a1-978f-20c31bf4e22e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:18.250422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b3e27a87-1803-45a1-978f-20c31bf4e22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:18.268582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e27a87-1803-45a1-978f-20c31bf4e22e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:18.274042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:18.274686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:18.274970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:18.275246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:18.284625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:18.286210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:18.297226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 956/1891] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:18 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:23.948759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:23.965138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e736fb-e239-465b-8e8c-adb383fa297c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:23.970035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:23.970695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:23.970980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:23.971253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:23.973086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:24.058897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:24.061289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c2bf-57e7-4602-9355-281ce326b17b service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:24.079889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 936/1892] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:23 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:26.434593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:26.505992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea79507-800b-458a-8db7-0d38d8f8d988 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:26.510937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:26.511991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:26.512340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:26.512682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] PATH_INFO: `/v3/users/9cd4b437827c49c39665532dda7c5d67` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:26.514086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd4b437827c49c39665532dda7c5d67)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:26.516395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:26.579586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd4b437827c49c39665532dda7c5d67'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:26.592895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd4b437827c49c39665532dda7c5d67'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:26.593620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd4b437827c49c39665532dda7c5d67'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:26.594227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd4b437827c49c39665532dda7c5d67'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:26.601509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd4b437827c49c39665532dda7c5d67'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:26.614665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 957/1893] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:26 2021] DELETE /identity/v3/users/9cd4b437827c49c39665532dda7c5d67 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:26.621128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:26.621644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:26.621727 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:26.644682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:26.645866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:26.720526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 937/1894] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:26.731432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:26.733112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:26.793788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367a71c-53de-498c-b922-6d68b789a514 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:26.798959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015952d-4212-4142-a1ce-d105dcdf46d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:26.799434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015952d-4212-4142-a1ce-d105dcdf46d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:26.799785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015952d-4212-4142-a1ce-d105dcdf46d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:26.800032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015952d-4212-4142-a1ce-d105dcdf46d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:26.809388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015952d-4212-4142-a1ce-d105dcdf46d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:26.811446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015952d-4212-4142-a1ce-d105dcdf46d0 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:26.821889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 958/1895] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:27.459737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:27.461682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:27.481333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c49c41-02f4-48ba-a86c-44775b50eede None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:27.486322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:27.487482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:27.488017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:27.488511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] PATH_INFO: `/v3/projects/9208b28fe5234ffba294a46aecd6008b` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:27.490138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9208b28fe5234ffba294a46aecd6008b)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:27.492399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:27.577998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9208b28fe5234ffba294a46aecd6008b', 'request_id': 'req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:27.591210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9208b28fe5234ffba294a46aecd6008b', 'request_id': 'req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:27.609768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9208b28fe5234ffba294a46aecd6008b', 'request_id': 'req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:27.636950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] The token cache is being invalidate because project 9208b28fe5234ffba294a46aecd6008b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:27.637854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:27.639697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-cf087bf8-bae2-4fbf-9f81-6fbbfabac269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:27.645383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 938/1896] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:27 2021] DELETE /identity/v3/projects/9208b28fe5234ffba294a46aecd6008b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:27.648517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:27.648992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:27.649151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:27.679417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:27.680711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:27.779360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 959/1897] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:27.787742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:27.788201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:27.788631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:27.809358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:27.811453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:27.824090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 939/1898] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:27.824985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:27.836470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c472e0-8396-4f92-8fc2-804c9d63ad37 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:27.845461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:27.848375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:27.849618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:27.849618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:27.849897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:27.850066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:27.852165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:27.868250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 960/1899] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:27.883174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:27.892908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59574ed4-6b5f-4ee5-b270-4497c954cdf9 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:27.897745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:27.898612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:27.899201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:27.899486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:27.900352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:27.902351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:27.931686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 940/1900] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:27 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:27.938358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:27.949944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a739e-b4c5-4295-924c-a725f3256e1c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:28.011880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:28.012649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:28.012936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:28.013246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:28.014561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:28.016626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:28.036373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 961/1901] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:27 2021] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:28.040566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:28.053283 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0b874-f62e-43c0-a4bd-d60011b217b1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:28.058491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:28.061768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:28.062151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:28.062498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:28.063361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:28.065010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:28.078321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 941/1902] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:28 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:28.082354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:28.095867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da846f-90b1-43ff-ab1e-1f05e6caddaa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:28.102425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184f161-0563-469c-9598-7190395be073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:28.103120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184f161-0563-469c-9598-7190395be073 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:28.103409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184f161-0563-469c-9598-7190395be073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:28.103734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184f161-0563-469c-9598-7190395be073 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:28.104492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184f161-0563-469c-9598-7190395be073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:28.106080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184f161-0563-469c-9598-7190395be073 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:28.127660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 962/1903] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:28 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:28.136022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:28.149734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363254f4-f76b-45a2-9d44-8cc30319dab2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:28.155222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:28.156158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:28.156436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:28.156718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] PATH_INFO: `/v3/projects/707f45d94106442ca9a0326ff5d34bad/users/226f410256e04545b55f44609b7a4291/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:28.174815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=707f45d94106442ca9a0326ff5d34bad, user_id=226f410256e04545b55f44609b7a4291, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:28.177522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:28.192358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 942/1904] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:28 2021] PUT /identity/v3/projects/707f45d94106442ca9a0326ff5d34bad/users/226f410256e04545b55f44609b7a4291/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:28.202410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:28.202718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:28.203018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:28.228870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] MFA Rules not processed for user `226f410256e04545b55f44609b7a4291`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:28.230203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:28.303338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 963/1905] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:28.315227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:28.317552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:28.372890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422136e-ebd3-4120-a316-36ffe9ba04ed admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:28.377123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee43fa-dea5-4fb2-96e4-1c1feb8747d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:28.377770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee43fa-dea5-4fb2-96e4-1c1feb8747d0 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:28.378058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee43fa-dea5-4fb2-96e4-1c1feb8747d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:28.378338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee43fa-dea5-4fb2-96e4-1c1feb8747d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:28.386607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee43fa-dea5-4fb2-96e4-1c1feb8747d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:28.388267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee43fa-dea5-4fb2-96e4-1c1feb8747d0 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:28.397514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 943/1906] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:28 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:32.244354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:32.245763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:32.325527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f7de6-2d02-434b-b005-2d206807e1f4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:32.333275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:32.334196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:32.334474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:32.334755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] PATH_INFO: `/v3/users/2c869e844b354acaa157e6ed7efebd34` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:32.336373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c869e844b354acaa157e6ed7efebd34)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:32.337952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:32.398447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c869e844b354acaa157e6ed7efebd34'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:32.414133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c869e844b354acaa157e6ed7efebd34'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:32.415445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c869e844b354acaa157e6ed7efebd34'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:32.416191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c869e844b354acaa157e6ed7efebd34'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:32.425050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c869e844b354acaa157e6ed7efebd34'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:32.439937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 964/1907] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:32 2021] DELETE /identity/v3/users/2c869e844b354acaa157e6ed7efebd34 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:32.445443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:32.445981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:32.445981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:32.463439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:32.464914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:32.535913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 944/1908] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:32.545920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:32.547686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:32.614949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d4711-3855-4a0c-ad5d-00e2ffadde78 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:32.619864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:32.620564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:32.620852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:32.621246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:32.631929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:32.633394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:32.643674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 965/1909] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:32.945253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:32.946922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:32.964942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9c66-20b7-4a3e-849c-0db1bc2f3396 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:32.970088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:32.970950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:32.971226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:32.971501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] PATH_INFO: `/v3/projects/c42a11fdf6254273b71e9f892d083b86` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:32.972912 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42a11fdf6254273b71e9f892d083b86)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:32.974837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.038163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42a11fdf6254273b71e9f892d083b86', 'request_id': 'req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.045334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42a11fdf6254273b71e9f892d083b86', 'request_id': 'req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.053746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42a11fdf6254273b71e9f892d083b86', 'request_id': 'req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.067431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] The token cache is being invalidate because project c42a11fdf6254273b71e9f892d083b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:33.067762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.068409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.069931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 945/1910] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:32 2021] DELETE /identity/v3/projects/c42a11fdf6254273b71e9f892d083b86 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:33.074046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.084023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749fb46-4981-4adf-beeb-f2c0b4a48592 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.141242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.142127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.142410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.142697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] PATH_INFO: `/v3/users/999b45131bf44523b9cef05edc6f518c` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.143943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999b45131bf44523b9cef05edc6f518c)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.145836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.196009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999b45131bf44523b9cef05edc6f518c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.207936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999b45131bf44523b9cef05edc6f518c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.208712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999b45131bf44523b9cef05edc6f518c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.209342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999b45131bf44523b9cef05edc6f518c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.217349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-11db7dd4-f167-4f89-99f4-c167e1d6cf88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999b45131bf44523b9cef05edc6f518c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.230225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 966/1911] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:33 2021] DELETE /identity/v3/users/999b45131bf44523b9cef05edc6f518c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:33.495326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.496803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:33.509348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aed00-ef0c-4d05-895f-9b7f56f94f41 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.564025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.564880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.565164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.565454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] PATH_INFO: `/v3/projects/bf5f426d9e5f43cc9178c42cb2930871` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.566658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf5f426d9e5f43cc9178c42cb2930871)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.568586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.613197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf5f426d9e5f43cc9178c42cb2930871', 'request_id': 'req-ee4550ce-487d-4347-9c33-0f205ea3b348'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.619135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf5f426d9e5f43cc9178c42cb2930871', 'request_id': 'req-ee4550ce-487d-4347-9c33-0f205ea3b348'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.626329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf5f426d9e5f43cc9178c42cb2930871', 'request_id': 'req-ee4550ce-487d-4347-9c33-0f205ea3b348'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.636777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] The token cache is being invalidate because project bf5f426d9e5f43cc9178c42cb2930871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:33.637064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.637710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ee4550ce-487d-4347-9c33-0f205ea3b348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:33.639810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 946/1912] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:33 2021] DELETE /identity/v3/projects/bf5f426d9e5f43cc9178c42cb2930871 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:33.646440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.646905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.647010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.664756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:33.665932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:33.721339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 967/1913] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:33.729670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.729961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.730241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.748322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:33.749141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:33.757015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 947/1914] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:33.761206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.772295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b70ab1-65a1-43e7-9873-5d74623d06f4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.777207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.777868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.778157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.778436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.779795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:33.780106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.781696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.793848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 968/1915] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:57:33.798243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.809226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77b3c3-89e7-4f4c-a182-2229910ace08 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.814446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.815105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.815388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.815744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.816451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.818367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.847523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 948/1916] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:33 2021] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:33.848672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.858414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab7e0-0e24-4066-80f8-3517e29c5a7c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.916198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.916875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.917162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.917444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.918154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.920097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.939333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 969/1917] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:33 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:33.943417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.954192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5ca9-9f59-4ab6-8500-b146fa1cf64e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.958795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.959450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.959776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.960058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.960798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.962396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:33.972523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 949/1918] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:33.976297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:33.987277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf89a91-d75e-4b22-83da-1de33b7e4a7a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:33.992156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4e50b-c659-4ade-a8ec-3d90eb051e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:33.992827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e50b-c659-4ade-a8ec-3d90eb051e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:33.993110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e50b-c659-4ade-a8ec-3d90eb051e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:33.993392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4e50b-c659-4ade-a8ec-3d90eb051e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:33.994137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4e50b-c659-4ade-a8ec-3d90eb051e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:33.995761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4e50b-c659-4ade-a8ec-3d90eb051e04 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:34.006570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 970/1919] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:34.010799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:34.021681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be866d44-e111-4b40-8471-f2b7dbc8f2b0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:34.026324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:34.027198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.027514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.027821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] PATH_INFO: `/v3/projects/bfcb9dc7766d453392fe55ed7152cbe5/users/8138c338c7e848d4a5e90f93016daeec/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.042044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcb9dc7766d453392fe55ed7152cbe5, user_id=8138c338c7e848d4a5e90f93016daeec, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:34.044731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:34.056788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 950/1920] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:34 2021] PUT /identity/v3/projects/bfcb9dc7766d453392fe55ed7152cbe5/users/8138c338c7e848d4a5e90f93016daeec/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:34.068458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.068755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.069038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.095922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] MFA Rules not processed for user `8138c338c7e848d4a5e90f93016daeec`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:34.097169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:34.156463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 971/1921] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:34.199248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:34.200936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:34.256456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a0d02-5e18-4257-8635-ec87dfdab1d5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:34.260128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4365-5936-4a9a-8b93-f3406a97439d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:34.260773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4365-5936-4a9a-8b93-f3406a97439d service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.261058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4365-5936-4a9a-8b93-f3406a97439d service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.261337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4365-5936-4a9a-8b93-f3406a97439d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.269535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4365-5936-4a9a-8b93-f3406a97439d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:34.270951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4365-5936-4a9a-8b93-f3406a97439d service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:34.279536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 951/1922] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:34 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:34.299476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:34.358834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061badf-aff7-4ef0-87c9-aef9d9f0608b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:34.372349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:34.374053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.374562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.375086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] PATH_INFO: `/v3/users/8138c338c7e848d4a5e90f93016daeec` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.376514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8138c338c7e848d4a5e90f93016daeec)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:34.378695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:34.426041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8138c338c7e848d4a5e90f93016daeec'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.437997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8138c338c7e848d4a5e90f93016daeec'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.438645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8138c338c7e848d4a5e90f93016daeec'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.439240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8138c338c7e848d4a5e90f93016daeec'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.446239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8138c338c7e848d4a5e90f93016daeec'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.457975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 972/1923] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:34 2021] DELETE /identity/v3/users/8138c338c7e848d4a5e90f93016daeec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:34.462449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.462744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.463027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.479774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:34.480957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:34.537379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 952/1924] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:34.547719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:34.549101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:34.603339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf086ecf-a327-42f2-b485-91f98ca8eed9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:34.607004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4709e1-f945-4f97-9505-1ff18908f8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:34.608280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4709e1-f945-4f97-9505-1ff18908f8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.608566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4709e1-f945-4f97-9505-1ff18908f8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.608847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4709e1-f945-4f97-9505-1ff18908f8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.617566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4709e1-f945-4f97-9505-1ff18908f8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:34.618978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4709e1-f945-4f97-9505-1ff18908f8c1 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:34.628484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 973/1925] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:34.875834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:34.877238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:34.889119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2d0d9-713a-40e9-a841-f7583462736b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:34.893833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:34.894818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.895107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.895382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] PATH_INFO: `/v3/projects/bfcb9dc7766d453392fe55ed7152cbe5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:34.896717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcb9dc7766d453392fe55ed7152cbe5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:34.898733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:34.947220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcb9dc7766d453392fe55ed7152cbe5', 'request_id': 'req-e534c315-7168-447a-95b8-dd0e9267faeb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.953911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcb9dc7766d453392fe55ed7152cbe5', 'request_id': 'req-e534c315-7168-447a-95b8-dd0e9267faeb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.961098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcb9dc7766d453392fe55ed7152cbe5', 'request_id': 'req-e534c315-7168-447a-95b8-dd0e9267faeb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.971853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] The token cache is being invalidate because project bfcb9dc7766d453392fe55ed7152cbe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:34.972081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.972711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e534c315-7168-447a-95b8-dd0e9267faeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:34.974245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 953/1926] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:34 2021] DELETE /identity/v3/projects/bfcb9dc7766d453392fe55ed7152cbe5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:34.980434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:34.980947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:34.981033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.001627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:35.002830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:35.067576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 974/1927] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:35.076640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.076940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.077226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.094933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:35.096164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:35.103984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 954/1928] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:35.108560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.118268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddacbc0-f51f-430f-9497-b97cf919aeba None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.123464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.124152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.124438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.124717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.125451 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:35.125759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.127348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.138621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 975/1929] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:35.142973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.152113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6a508-ffb5-428c-9694-08be44e303c5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.156786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.157704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.157986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.158282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.158975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.160902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.185507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 955/1930] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:35 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:35.189592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.199140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0603c-c8b9-482f-a5b0-a5769b98541f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.254332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.255057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.255346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.255650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.256478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.258423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.277004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 976/1931] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:35 2021] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:35.281664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.291885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf1552-b76e-450d-81ea-59de7cc707d7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.297022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.297702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.297988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.298265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.299000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.300612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.310516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 956/1932] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:35.314241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.324058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b22c2c-bc92-4ef6-8e61-8098121bba47 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.328717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39d01c-9bd2-45f1-9906-0656a1d55606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.329252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39d01c-9bd2-45f1-9906-0656a1d55606 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.329542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39d01c-9bd2-45f1-9906-0656a1d55606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.329822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39d01c-9bd2-45f1-9906-0656a1d55606 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.330695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39d01c-9bd2-45f1-9906-0656a1d55606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.332320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39d01c-9bd2-45f1-9906-0656a1d55606 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.345896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 977/1933] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:35.347238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.357016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bcc52-75ae-4f6b-b986-84106c716339 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.362174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.363044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.363328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.363606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] PATH_INFO: `/v3/projects/0bab423d141e49b29b86b769cfa8d939/users/0952832b106844dea05a888f4266dd95/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.377390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bab423d141e49b29b86b769cfa8d939, user_id=0952832b106844dea05a888f4266dd95, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.380062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.392729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 957/1934] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:35 2021] PUT /identity/v3/projects/0bab423d141e49b29b86b769cfa8d939/users/0952832b106844dea05a888f4266dd95/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:35.397631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a98ab-0a5e-4c22-a3ff-7f10fd4fb421 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.397925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a98ab-0a5e-4c22-a3ff-7f10fd4fb421 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.398207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a98ab-0a5e-4c22-a3ff-7f10fd4fb421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.416296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-397a98ab-0a5e-4c22-a3ff-7f10fd4fb421 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:35.417484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-397a98ab-0a5e-4c22-a3ff-7f10fd4fb421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:35.474848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 978/1935] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:35.484743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:35.486418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:35.539835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651dcac-539b-4627-8ceb-fda5c85381e2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:35.543515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:35.544185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:35.544472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:35.544754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:35.553621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:35.555049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:35.564926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 958/1936] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:36.442269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:36.442809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:36.442897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:36.473793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] MFA Rules not processed for user `0952832b106844dea05a888f4266dd95`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:36.475035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:36.556580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 979/1937] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:36 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:36.567729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:36.569148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:36.630474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ec0bb-eb30-4910-b980-e4407a5cacb1 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:36.634137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04cb18-6ae0-49b2-a817-58e4d20f79b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:36.634789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04cb18-6ae0-49b2-a817-58e4d20f79b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:36.635075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04cb18-6ae0-49b2-a817-58e4d20f79b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:36.635361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04cb18-6ae0-49b2-a817-58e4d20f79b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:36.643900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04cb18-6ae0-49b2-a817-58e4d20f79b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:36.645343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04cb18-6ae0-49b2-a817-58e4d20f79b5 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:36.654212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 959/1938] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:36 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:37.316731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:37.318282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:37.331591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644257a-7faa-41a7-bd88-53f511cafc4a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:37.336327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:37.337866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:37.338229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:37.338589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] PATH_INFO: `/v3/users/226f410256e04545b55f44609b7a4291` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:37.339976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=226f410256e04545b55f44609b7a4291)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:37.342354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:37.394186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226f410256e04545b55f44609b7a4291'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:37.407982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226f410256e04545b55f44609b7a4291'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:37.409037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226f410256e04545b55f44609b7a4291'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:37.410683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226f410256e04545b55f44609b7a4291'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:37.421685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226f410256e04545b55f44609b7a4291'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:37.435035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 980/1939] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:37 2021] DELETE /identity/v3/users/226f410256e04545b55f44609b7a4291 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:37.440289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:37.440586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:37.440950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:37.458379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:37.459581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:37.541070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 960/1940] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:37.551963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:37.553688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:37.634475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d920-c4a8-4e65-93f8-2c30cb45c236 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:37.639375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f806-a413-4375-a1f8-1ece50beb2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:37.640215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f806-a413-4375-a1f8-1ece50beb2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:37.640745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f806-a413-4375-a1f8-1ece50beb2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:37.641264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f806-a413-4375-a1f8-1ece50beb2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:37.653380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f806-a413-4375-a1f8-1ece50beb2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:37.657896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f806-a413-4375-a1f8-1ece50beb2f1 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:37.678059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 981/1941] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:37.986154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:37.987638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:37.993394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33acfa6-92f3-4ca1-b47e-f2649550744f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:37.993692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33acfa6-92f3-4ca1-b47e-f2649550744f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:37.993978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33acfa6-92f3-4ca1-b47e-f2649550744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.000654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0731bb6-b7a1-424b-8984-f87fab4387dc None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.005567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.006689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.006976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.007298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] PATH_INFO: `/v3/projects/707f45d94106442ca9a0326ff5d34bad` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.008559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=707f45d94106442ca9a0326ff5d34bad)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.010492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.017939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b33acfa6-92f3-4ca1-b47e-f2649550744f None None] MFA Rules not processed for user `0952832b106844dea05a888f4266dd95`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:38.019210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b33acfa6-92f3-4ca1-b47e-f2649550744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:38.060768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707f45d94106442ca9a0326ff5d34bad', 'request_id': 'req-dd731f46-4edf-428d-b4ba-c0820ac4adc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:38.067251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707f45d94106442ca9a0326ff5d34bad', 'request_id': 'req-dd731f46-4edf-428d-b4ba-c0820ac4adc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:38.075217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707f45d94106442ca9a0326ff5d34bad', 'request_id': 'req-dd731f46-4edf-428d-b4ba-c0820ac4adc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:38.077725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 982/1942] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:37 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:38.087152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] The token cache is being invalidate because project 707f45d94106442ca9a0326ff5d34bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:38.087443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:38.088107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dd731f46-4edf-428d-b4ba-c0820ac4adc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:38.089987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 961/1943] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:37 2021] DELETE /identity/v3/projects/707f45d94106442ca9a0326ff5d34bad => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:38.096113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64e43-205c-4013-948a-8698683cf28d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.096405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64e43-205c-4013-948a-8698683cf28d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.096687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64e43-205c-4013-948a-8698683cf28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.115007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-97c64e43-205c-4013-948a-8698683cf28d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:38.116069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-97c64e43-205c-4013-948a-8698683cf28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:38.177448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 983/1944] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:38.184568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.184858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.185175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.205835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:38.207118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:38.216089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 962/1945] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:38.220580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64e43-205c-4013-948a-8698683cf28d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.232276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64e43-205c-4013-948a-8698683cf28d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.237185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.237907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.238206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.238484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.239265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:38.239751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.241509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.255701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 984/1946] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:38.258246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.268614 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50e2cb-1dbb-4f78-b707-4295ce29aa24 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.275386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.276203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.276706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.277196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.278114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.280892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.332483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 963/1947] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:38 2021] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:38.332595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.342661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffe886-5098-413d-8073-4eac44b1a541 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.400395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.401056 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.401342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.401625 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.402330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.404342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.425160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 985/1948] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:38 2021] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:38.429482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.443564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657bf31-6090-4833-8772-19d49df644d0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.448756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.449573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.449970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.450362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.451793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.453451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.464578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 964/1949] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:38 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:38.468553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.478183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3282b31-099a-4022-954c-8873ce171d69 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.482876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa6c82-5882-417d-a283-61255dd845b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.483533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6c82-5882-417d-a283-61255dd845b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.483857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6c82-5882-417d-a283-61255dd845b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.484139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa6c82-5882-417d-a283-61255dd845b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.484912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6c82-5882-417d-a283-61255dd845b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.486487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa6c82-5882-417d-a283-61255dd845b8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.496667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 986/1950] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:38 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:38.501396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.511108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886e943-0f04-43f3-9103-ad3d82c10852 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.516355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.517245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.517533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.517817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] PATH_INFO: `/v3/projects/58cbb64ed13544249937344781d743cd/users/ea9f0336a1bf4f6e8e1447a80fb166fe/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.532633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cbb64ed13544249937344781d743cd, user_id=ea9f0336a1bf4f6e8e1447a80fb166fe, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.535344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.548746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 965/1951] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:38 2021] PUT /identity/v3/projects/58cbb64ed13544249937344781d743cd/users/ea9f0336a1bf4f6e8e1447a80fb166fe/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:38.560923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.561385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.561494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.588720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] MFA Rules not processed for user `ea9f0336a1bf4f6e8e1447a80fb166fe`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:38.590087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:38.664359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 987/1952] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:38 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:38.678029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:38.679829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:38.744692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134427c-8c21-496a-9557-1ed6723747f7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:38.748945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454f3b2-15f2-4071-b5a5-5ef2a37035d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:38.749592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454f3b2-15f2-4071-b5a5-5ef2a37035d4 service glance] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:38.749877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454f3b2-15f2-4071-b5a5-5ef2a37035d4 service glance] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:38.750208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454f3b2-15f2-4071-b5a5-5ef2a37035d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:38.758778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454f3b2-15f2-4071-b5a5-5ef2a37035d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:38.760244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454f3b2-15f2-4071-b5a5-5ef2a37035d4 service glance] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:38.769094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 966/1953] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:38 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:40.769692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:40.771636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:40.875033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de95c-1176-4717-9208-2cef26cf88fb None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:40.879841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:40.880921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:40.881335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:40.881736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] PATH_INFO: `/v3/users/4587036edcab42c68048d18ba8973023` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:40.883267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4587036edcab42c68048d18ba8973023)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:40.885479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:40.954547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4587036edcab42c68048d18ba8973023'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:40.968173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4587036edcab42c68048d18ba8973023'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:40.969025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4587036edcab42c68048d18ba8973023'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:40.970100 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4587036edcab42c68048d18ba8973023'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:40.981101 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4587036edcab42c68048d18ba8973023'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:40.997154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 988/1954] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:40 2021] DELETE /identity/v3/users/4587036edcab42c68048d18ba8973023 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:41.001661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:41.002205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:41.002311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:41.023950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:41.025960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:41.093429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 967/1955] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:41.104852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:41.106883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:41.184426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce6604-ba6a-4d79-a6e6-a06b1a7e9fb0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:41.189093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:41.190046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:41.190474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:41.190892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:41.203250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:41.205649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:41.219287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 989/1956] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:41.720580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:41.722191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:41.736569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bda44-bc08-4788-8915-d5fb082278e7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:41.744176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:41.745118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:41.745466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:41.745822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] PATH_INFO: `/v3/projects/3d61cd1d8c9548baa4d4144d3e0a6eb7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:41.748460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d61cd1d8c9548baa4d4144d3e0a6eb7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:41.752078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:41.812685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d61cd1d8c9548baa4d4144d3e0a6eb7', 'request_id': 'req-29dcd999-d4a7-4568-a645-060edcfc2d43'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:41.820453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d61cd1d8c9548baa4d4144d3e0a6eb7', 'request_id': 'req-29dcd999-d4a7-4568-a645-060edcfc2d43'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:41.828694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d61cd1d8c9548baa4d4144d3e0a6eb7', 'request_id': 'req-29dcd999-d4a7-4568-a645-060edcfc2d43'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:41.840828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] The token cache is being invalidate because project 3d61cd1d8c9548baa4d4144d3e0a6eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:41.841127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:41.842071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:41.843599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 968/1957] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:41 2021] DELETE /identity/v3/projects/3d61cd1d8c9548baa4d4144d3e0a6eb7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:41.847592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:41.862091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef8faf-0dd9-413a-b8f6-5be95088811f service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:41.929435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:41.930594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:41.931077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:41.931454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] PATH_INFO: `/v3/users/eff287c96b69400db6c6de90661dae6e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:41.933496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff287c96b69400db6c6de90661dae6e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:41.936285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:41.999944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff287c96b69400db6c6de90661dae6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.011989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff287c96b69400db6c6de90661dae6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.012778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff287c96b69400db6c6de90661dae6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.013904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff287c96b69400db6c6de90661dae6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.021448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff287c96b69400db6c6de90661dae6e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.036596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 990/1958] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:41 2021] DELETE /identity/v3/users/eff287c96b69400db6c6de90661dae6e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:42.630670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:42.632220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:42.647790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcd999-d4a7-4568-a645-060edcfc2d43 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:42.713856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:42.714749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:42.715039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:42.715578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] PATH_INFO: `/v3/projects/52b00633f3684a229f4572d5365aa533` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:42.717587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b00633f3684a229f4572d5365aa533)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:42.722575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:42.722734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:42.724249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:42.737847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27048b0a-3133-472a-8654-3786f0a92f6a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:42.742875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:42.743790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:42.744080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:42.744362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] PATH_INFO: `/v3/users/db8ffd42bed34a3a8a060d38976807bd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:42.745571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8ffd42bed34a3a8a060d38976807bd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:42.747842 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:42.779711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b00633f3684a229f4572d5365aa533', 'request_id': 'req-0799d8e9-8c27-487a-9b8f-d2d406e3308b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.787690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b00633f3684a229f4572d5365aa533', 'request_id': 'req-0799d8e9-8c27-487a-9b8f-d2d406e3308b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.796222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b00633f3684a229f4572d5365aa533', 'request_id': 'req-0799d8e9-8c27-487a-9b8f-d2d406e3308b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.801127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8ffd42bed34a3a8a060d38976807bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.812545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] The token cache is being invalidate because project 52b00633f3684a229f4572d5365aa533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:42.812988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.813644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0799d8e9-8c27-487a-9b8f-d2d406e3308b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.814400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8ffd42bed34a3a8a060d38976807bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.815104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8ffd42bed34a3a8a060d38976807bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.815539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 969/1959] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:42 2021] DELETE /identity/v3/projects/52b00633f3684a229f4572d5365aa533 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:42.819607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8ffd42bed34a3a8a060d38976807bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.821071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:42.821355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:42.821778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:42.829050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f5ec1499-520b-4a1a-b44c-502b53a31345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8ffd42bed34a3a8a060d38976807bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:42.847990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:42.848692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 991/1960] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:42 2021] DELETE /identity/v3/users/db8ffd42bed34a3a8a060d38976807bd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:42.850068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:42.935672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 970/1961] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:42.991439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:42.991772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:42.992063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.011035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:43.012292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.021675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 992/1962] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:43.027847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.048113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725e0df-71f7-4359-8ccd-49eb4546ab42 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.048113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.048113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.048113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.048508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.048508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:43.048508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.048508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.059610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 971/1963] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:43.064545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.073984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66845a39-df52-4fb0-9ddd-24ff1254b581 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.079352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.080129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.080421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.080705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.081436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.083338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.114001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 993/1964] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:43 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:43.116479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.125955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.127923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d564ca-deb0-485f-a35c-ab975c0b623c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.128072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.199317 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184445c7-fed1-464e-b51a-a1ffbed5e5e2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.205424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.205571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.206448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.206633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.206795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.206892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.207219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.207332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] PATH_INFO: `/v3/projects/f87c221849fc4d01ab8f2e881e81ecc8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.208203 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.208789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87c221849fc4d01ab8f2e881e81ecc8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.210818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.214604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.238373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 972/1965] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:43 2021] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:43.243476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.258537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab611d4-f37f-4bcd-b7ef-3ba9840ef08f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.271250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87c221849fc4d01ab8f2e881e81ecc8', 'request_id': 'req-d05fd666-aace-4875-b857-45d70ae439e1'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.279369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87c221849fc4d01ab8f2e881e81ecc8', 'request_id': 'req-d05fd666-aace-4875-b857-45d70ae439e1'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.286613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87c221849fc4d01ab8f2e881e81ecc8', 'request_id': 'req-d05fd666-aace-4875-b857-45d70ae439e1'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.302443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] The token cache is being invalidate because project f87c221849fc4d01ab8f2e881e81ecc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:43.302443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.302443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.303127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 994/1966] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:43 2021] DELETE /identity/v3/projects/f87c221849fc4d01ab8f2e881e81ecc8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:43.307745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.309168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.322177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.322947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.323306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.323684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.325067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.326262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.339401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 973/1967] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:43 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:43.340766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.342775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.358325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc89d13-54dc-4783-b40c-e98e97ea46c3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.363565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.364404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.364792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.365191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.366044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.367923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.384295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fd666-aace-4875-b857-45d70ae439e1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.384503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 974/1968] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:43 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:43.385550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.390626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.392014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.392617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.393058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] PATH_INFO: `/v3/users/b96074fc45bf4d9794ac27e5c844e210` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.395049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96074fc45bf4d9794ac27e5c844e210)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.397681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.399259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78847601-a15a-4d25-a721-38f79e9ae56d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.406332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23aba6-817e-4477-9ac6-1988af1ee20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.407725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23aba6-817e-4477-9ac6-1988af1ee20c admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.408135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23aba6-817e-4477-9ac6-1988af1ee20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.408419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23aba6-817e-4477-9ac6-1988af1ee20c admin admin] PATH_INFO: `/v3/projects/f41f5f58bfb94802bdc4d0baeb8bac44/users/6304e74c996e40a18439e9a2dab1360c/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.425611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23aba6-817e-4477-9ac6-1988af1ee20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41f5f58bfb94802bdc4d0baeb8bac44, user_id=6304e74c996e40a18439e9a2dab1360c, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.428560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23aba6-817e-4477-9ac6-1988af1ee20c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.456440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 975/1969] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:43 2021] PUT /identity/v3/projects/f41f5f58bfb94802bdc4d0baeb8bac44/users/6304e74c996e40a18439e9a2dab1360c/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:43.456806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96074fc45bf4d9794ac27e5c844e210'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.459143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.459609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.460045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.470483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96074fc45bf4d9794ac27e5c844e210'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.471347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96074fc45bf4d9794ac27e5c844e210'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.472015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96074fc45bf4d9794ac27e5c844e210'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.481520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96074fc45bf4d9794ac27e5c844e210'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.490555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] MFA Rules not processed for user `6304e74c996e40a18439e9a2dab1360c`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:43.491796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.499392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 995/1970] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:43 2021] DELETE /identity/v3/users/b96074fc45bf4d9794ac27e5c844e210 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:43.585758 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 976/1971] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:43 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:43.592995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.594800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.690264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4373c0c-30f7-4f4e-851a-8456dfba6455 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.698251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.699028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.699926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.700292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.713246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.713246 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.735238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 996/1972] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:43 2021] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:43.741392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.759781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.761374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.820645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18a6de-d6f7-4726-9039-c25e51b0a94f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.836132 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076e6a0-613b-45ef-9e63-107169edf116 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.841177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.842045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.842334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.842614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] PATH_INFO: `/v3/projects/2d14db71de884cf3ac70961926420fe6` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.843839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d14db71de884cf3ac70961926420fe6)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.845750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.881770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.882454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.882735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.883012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.883755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.885705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.893871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d14db71de884cf3ac70961926420fe6', 'request_id': 'req-c8563868-5902-44dc-a0e9-852dc16da551'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.901013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d14db71de884cf3ac70961926420fe6', 'request_id': 'req-c8563868-5902-44dc-a0e9-852dc16da551'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.906060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 977/1973] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:43 2021] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:43.908016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d14db71de884cf3ac70961926420fe6', 'request_id': 'req-c8563868-5902-44dc-a0e9-852dc16da551'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.910100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.918664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] The token cache is being invalidate because project 2d14db71de884cf3ac70961926420fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:43.918953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.919981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bb01a-caee-490c-bef4-431a4940a0a9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:43.921280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-c8563868-5902-44dc-a0e9-852dc16da551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:43.923005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 997/1974] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:43 2021] DELETE /identity/v3/projects/2d14db71de884cf3ac70961926420fe6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:43.928315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a390-a24f-421e-8eb8-2909e467347d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.928807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a390-a24f-421e-8eb8-2909e467347d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.929169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a390-a24f-421e-8eb8-2909e467347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.950141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b093a390-a24f-421e-8eb8-2909e467347d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:43.951575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b093a390-a24f-421e-8eb8-2909e467347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:43.973922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:43.974511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:43.974792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:43.975063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:43.975831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:43.977407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:43.987478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 978/1975] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:43 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:43.991495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:43.993253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.006951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cec86a-0f83-4ea3-929d-14fd863dc9a8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.012306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.013039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.013331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.013613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.014400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.016195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.030505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 979/1976] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:43 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:44.032280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.042588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcf73c-81a1-4371-8623-8cdd3955383a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.048260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ba605-becb-4565-a1ab-5eb6687a9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.050414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba605-becb-4565-a1ab-5eb6687a9040 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.050414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba605-becb-4565-a1ab-5eb6687a9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.050414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ba605-becb-4565-a1ab-5eb6687a9040 admin admin] PATH_INFO: `/v3/projects/b3473cff065a4fa5b113f0878105e734/users/63f9333a34e346899d098a173b62f37b/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.067567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba605-becb-4565-a1ab-5eb6687a9040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3473cff065a4fa5b113f0878105e734, user_id=63f9333a34e346899d098a173b62f37b, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.070374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ba605-becb-4565-a1ab-5eb6687a9040 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.086485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 980/1977] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:44 2021] PUT /identity/v3/projects/b3473cff065a4fa5b113f0878105e734/users/63f9333a34e346899d098a173b62f37b/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:44.097403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.098034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.098602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.130223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] MFA Rules not processed for user `63f9333a34e346899d098a173b62f37b`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:44.131644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.139902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 998/1978] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:44.145557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.145883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.146393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.169086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:44.171781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.221924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 981/1979] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:44.228617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.254197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 999/1980] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:44.259492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.270466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b6bbf-f7b5-42a3-a58a-b4804b324785 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.275034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.275720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.276010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.276288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.277033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:44.277343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.279550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.291179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1000/1981] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:57:44.295933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.304909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcdabe-2f22-443e-94cf-496d4915356d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.305641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f44352-c2eb-4c82-957f-8eb800c5204b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.309702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.310364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.310594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.310713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.310913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.311250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.311532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.311662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.311841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.312556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.313587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.314472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.339627 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 982/1982] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:44.343365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1001/1983] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:44.344273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.344541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.402429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a08d6-a2c8-423f-a30e-4ac8db994eeb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.405981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1165-0b54-4d87-877a-91f96ab44bfa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.407995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.408662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.408951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.409229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.409930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.411081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.411786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.411877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.412125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.412409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.413193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.415134 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.435400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 983/1984] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:44.438850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1002/1985] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:44.439689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.439926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.449180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f9a62-b184-44b1-81e7-d673db3260e9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.449345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f9ff1-78cb-428c-8c72-93946c04e8a1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.453692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.454100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.454337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.454623 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.454753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.454901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.455041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.455322 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.455667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.456103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.457260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.457683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.467590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1003/1986] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:44.470397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 984/1987] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:44.471352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.474127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.480709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec0f0b-e4a8-4ceb-8964-9da4f60edcbf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.489538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.489759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a09682-2f77-4f6f-a56c-60093308fd4a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.491105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.491509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.491830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.492607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.494245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.495294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.496753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.497047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.497327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] PATH_INFO: `/v3/projects/dbfe40390d9e4d338afb42e957fcd48a/users/c164a2378d7f4ea9ba78976650e2d538/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.505882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1004/1988] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:44.510387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.516312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfe40390d9e4d338afb42e957fcd48a, user_id=c164a2378d7f4ea9ba78976650e2d538, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.519164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.520094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbc985-ae4b-48b7-a552-8202fac2f186 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.525584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45751d7-6cad-4806-a420-6c08f8ba7969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.526391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45751d7-6cad-4806-a420-6c08f8ba7969 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.526689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45751d7-6cad-4806-a420-6c08f8ba7969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.526970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45751d7-6cad-4806-a420-6c08f8ba7969 admin admin] PATH_INFO: `/v3/projects/fdb320651f2a4c848273e8cd2c5f4b24/users/beb0ba45b1fa46da85e368d5fa0c6b0d/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.534536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 985/1989] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:44 2021] PUT /identity/v3/projects/dbfe40390d9e4d338afb42e957fcd48a/users/c164a2378d7f4ea9ba78976650e2d538/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:44.538383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.542780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45751d7-6cad-4806-a420-6c08f8ba7969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb320651f2a4c848273e8cd2c5f4b24, user_id=beb0ba45b1fa46da85e368d5fa0c6b0d, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.546043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45751d7-6cad-4806-a420-6c08f8ba7969 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.561571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1005/1990] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:44 2021] PUT /identity/v3/projects/fdb320651f2a4c848273e8cd2c5f4b24/users/beb0ba45b1fa46da85e368d5fa0c6b0d/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:44.573342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.573642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.573930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.603169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] MFA Rules not processed for user `beb0ba45b1fa46da85e368d5fa0c6b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:44.604506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.621691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2df627-2925-4e82-bd95-c3f2c92580e6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.692154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1006/1991] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:44.703739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.704605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.705422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.705723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.706028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.706941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.707069 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.709505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.724334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 986/1992] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:44.726522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.747012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deffab6-fcd8-43e8-92b4-4ada5713b217 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.758164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58663c7e-a806-405d-a821-df8f363d5b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.758777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663c7e-a806-405d-a821-df8f363d5b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.759057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663c7e-a806-405d-a821-df8f363d5b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.759338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58663c7e-a806-405d-a821-df8f363d5b3d admin admin] PATH_INFO: `/v3/projects/dbfe40390d9e4d338afb42e957fcd48a/users/c164a2378d7f4ea9ba78976650e2d538/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.761486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58663c7e-a806-405d-a821-df8f363d5b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfe40390d9e4d338afb42e957fcd48a, user_id=c164a2378d7f4ea9ba78976650e2d538, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.764748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58663c7e-a806-405d-a821-df8f363d5b3d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.779757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 987/1993] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:44 2021] PUT /identity/v3/projects/dbfe40390d9e4d338afb42e957fcd48a/users/c164a2378d7f4ea9ba78976650e2d538/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:44.791638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.792024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.792376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.806144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858e772-6223-48a4-8ca7-a232824d6a5f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.822679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] MFA Rules not processed for user `c164a2378d7f4ea9ba78976650e2d538`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:44.823923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.857761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.858504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.858861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.859212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.891285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 988/1994] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:44 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:44.901030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:44.902387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:44.913960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdbcbc-5291-4ac9-bb3f-1b97b6e7fd78 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:44.914972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.916432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.917604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0c66c-6dc2-4602-bbf6-cd64a764cc73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:44.918249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c66c-6dc2-4602-bbf6-cd64a764cc73 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:44.918536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c66c-6dc2-4602-bbf6-cd64a764cc73 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:44.918815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0c66c-6dc2-4602-bbf6-cd64a764cc73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:44.926312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1007/1995] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:44.929475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c66c-6dc2-4602-bbf6-cd64a764cc73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:44.930915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0c66c-6dc2-4602-bbf6-cd64a764cc73 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:44.940595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 989/1996] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:44 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:44.945309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:45.009200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7cfdf-e9a6-451c-af8c-32796dbe3122 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:45.014692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:45.015570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.015888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.016172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] PATH_INFO: `/v3/users/beb0ba45b1fa46da85e368d5fa0c6b0d` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.017398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb0ba45b1fa46da85e368d5fa0c6b0d)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:45.019322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:45.066675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb0ba45b1fa46da85e368d5fa0c6b0d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.079984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb0ba45b1fa46da85e368d5fa0c6b0d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.080696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb0ba45b1fa46da85e368d5fa0c6b0d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.081318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb0ba45b1fa46da85e368d5fa0c6b0d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.088610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb0ba45b1fa46da85e368d5fa0c6b0d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.105096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1008/1997] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:44 2021] DELETE /identity/v3/users/beb0ba45b1fa46da85e368d5fa0c6b0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:45.109863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.110159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.110440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.129119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:45.130310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.188161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 990/1998] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:45.199395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:45.201485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.275806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571d8b1-2530-4bcd-b76e-1cf441513471 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:45.278521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:45.279249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.279541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.279857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.291974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:45.293580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:45.303839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1009/1999] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:45.422297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:45.424188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.489023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a399a44-91da-440d-a88d-286d8f32e9aa None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:45.496249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:45.496999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.497613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.498329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.502445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.587264 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:45.588743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8b038-0f76-4c2f-a9a1-14cd0c5e23ee service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:45.597610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 991/2000] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:45 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:45.691021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:45.692891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.707650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529e22c-ca50-417c-85a7-597143a66002 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:45.713841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:45.714914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.715328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.715831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] PATH_INFO: `/v3/projects/fdb320651f2a4c848273e8cd2c5f4b24` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.717255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb320651f2a4c848273e8cd2c5f4b24)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:45.720130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:45.776403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb320651f2a4c848273e8cd2c5f4b24', 'request_id': 'req-f78196a5-163b-4986-99c3-fa77325aa5cc'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.785017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb320651f2a4c848273e8cd2c5f4b24', 'request_id': 'req-f78196a5-163b-4986-99c3-fa77325aa5cc'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.791679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb320651f2a4c848273e8cd2c5f4b24', 'request_id': 'req-f78196a5-163b-4986-99c3-fa77325aa5cc'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.803057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] The token cache is being invalidate because project fdb320651f2a4c848273e8cd2c5f4b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:45.803351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.804027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f78196a5-163b-4986-99c3-fa77325aa5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:45.805574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1010/2001] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:45 2021] DELETE /identity/v3/projects/fdb320651f2a4c848273e8cd2c5f4b24 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:45.811905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.812370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.812370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.851552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:45.852930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.938612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 992/2002] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:45.948057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:45.948995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:45.949506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:45.969741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:45.971186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:45.980782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1011/2003] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:45.987037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:45.997142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c08911-009d-4405-af80-e6dac23b9068 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.002157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.003240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.003645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.003992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.004812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:46.005194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.006890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.019862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 993/2004] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:46.023910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.034346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888f0e3-94a6-4c01-b451-db080f08dc1e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.041412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.042611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.043251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.043718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.045248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.047344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.072772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1012/2005] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:46 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:46.077492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.088218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a6c4f-0f9c-4e40-b839-458b8a352481 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.142855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.143534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.143858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.144140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.144863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.146777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.168550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 994/2006] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:46 2021] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:46.173392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.183878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888200a0-20b5-472f-9cf4-ae14695e3268 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.188620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.189315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.189599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.189876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.190609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.192243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.205512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1013/2007] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:46.210200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.225043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa4c67-8d41-40ce-b2b3-6a9dd45467c4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.229870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a851d-0384-408d-80cd-7532a384affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.230599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a851d-0384-408d-80cd-7532a384affd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.230979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a851d-0384-408d-80cd-7532a384affd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.231321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a851d-0384-408d-80cd-7532a384affd admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.232208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a851d-0384-408d-80cd-7532a384affd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.233816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a851d-0384-408d-80cd-7532a384affd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.243717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 995/2008] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:46.247967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.259475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644112b5-d017-4615-9d8c-da8096706341 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.264749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.265696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.266041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.266321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] PATH_INFO: `/v3/projects/5c56111f196c41cd9b5439ac354e0581/users/37c9965df05a4f99957deccc28fc2b96/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.281247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c56111f196c41cd9b5439ac354e0581, user_id=37c9965df05a4f99957deccc28fc2b96, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.284224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.297440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1014/2009] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:46 2021] PUT /identity/v3/projects/5c56111f196c41cd9b5439ac354e0581/users/37c9965df05a4f99957deccc28fc2b96/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:46.307352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.307670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.307965 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.335008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] MFA Rules not processed for user `37c9965df05a4f99957deccc28fc2b96`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:46.336254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:46.400371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 996/2010] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:46 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:46.404818 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.465382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadf3fa-75a5-4cbb-ad20-6ecbb2d41c9e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.470230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.470894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.471291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.471573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.472413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.474428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.502172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1015/2011] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:46 2021] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:46.503355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.515121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb51f00-fa4a-4df4-ad6f-50f5c27fc27f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.576303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.576991 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.577414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.577704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.578419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.580418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.603675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 997/2012] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:46 2021] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:46.607211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.617367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d8dd5-d62d-4f70-b0f5-fc43f5ed64a7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.622125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.623310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.623601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.623927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.626774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.626774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.637186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1016/2013] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:46.642121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.651990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f800382-afb4-4691-9312-a74d77fb9784 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.656636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.657788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.658076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.658352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] PATH_INFO: `/v3/projects/9e206304430b44b2a69c17e370fc36ac/users/099e566a049f4163a3acc2420d19c96c/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.673256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e206304430b44b2a69c17e370fc36ac, user_id=099e566a049f4163a3acc2420d19c96c, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.675941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.692169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 998/2014] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:46 2021] PUT /identity/v3/projects/9e206304430b44b2a69c17e370fc36ac/users/099e566a049f4163a3acc2420d19c96c/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:46.696439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.707367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c858e-01ec-4056-b609-a9eb8fec88bd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.761877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e891b-3ffc-4f76-aafa-ec761fcbe454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.762471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e891b-3ffc-4f76-aafa-ec761fcbe454 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.762763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e891b-3ffc-4f76-aafa-ec761fcbe454 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.763636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e891b-3ffc-4f76-aafa-ec761fcbe454 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.764385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e891b-3ffc-4f76-aafa-ec761fcbe454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.765970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e891b-3ffc-4f76-aafa-ec761fcbe454 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.775290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1017/2015] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:46 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:46.779466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.790084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0219db4-b70f-451e-a984-4eddb3f6ad40 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:46.794772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:46.795588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.795895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.796167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] PATH_INFO: `/v3/projects/9e206304430b44b2a69c17e370fc36ac/users/099e566a049f4163a3acc2420d19c96c/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.798130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e206304430b44b2a69c17e370fc36ac, user_id=099e566a049f4163a3acc2420d19c96c, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:46.800783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:46.811891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 999/2016] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:46 2021] PUT /identity/v3/projects/9e206304430b44b2a69c17e370fc36ac/users/099e566a049f4163a3acc2420d19c96c/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:46.821837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:46.822134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:46.822418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:46.848573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] MFA Rules not processed for user `099e566a049f4163a3acc2420d19c96c`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:46.849797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:46.916518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1018/2017] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:46 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:46.927851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:46.929834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:47.001134 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2948a37-9f43-4c03-9258-47c4917bb692 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:47.004833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:47.005485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:47.005774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:47.006055 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:47.069075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:47.070534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:47.081065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1000/2018] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:46 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:49.762656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:49.765064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:49.780328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c0c29-f638-450e-a4c7-cb25816b78d9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:49.784154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:49.784809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:49.785097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:49.785377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:49.787181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:49.859423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:49.861193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f9ac8-327f-4429-b643-684eec5b17fb service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:49.872712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1019/2019] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:49 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:50.698302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:50.761756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cf956-bf2b-4060-8d29-f111323692ad service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:50.767039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:50.767954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:50.768240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:50.768519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] PATH_INFO: `/v3/users/37c9965df05a4f99957deccc28fc2b96` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:50.769722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c9965df05a4f99957deccc28fc2b96)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:50.771692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:50.817394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c9965df05a4f99957deccc28fc2b96'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:50.824181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c9965df05a4f99957deccc28fc2b96'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:50.825088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c9965df05a4f99957deccc28fc2b96'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:50.837170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c9965df05a4f99957deccc28fc2b96'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:50.844971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c9965df05a4f99957deccc28fc2b96'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:50.851116 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1001/2020] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:50 2021] DELETE /identity/v3/users/37c9965df05a4f99957deccc28fc2b96 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:50.855688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:50.856139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:50.856278 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:50.872673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:50.873929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:50.938846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1020/2021] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:50.949713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:50.951786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:51.014221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71367679-fe76-4fb6-9176-03bea7663854 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:51.028153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:51.029477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:51.029767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:51.030070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:51.040721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:51.042364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:51.056583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1002/2022] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:51.347933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:51.350507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:51.374760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ac643-ca9f-4c87-9875-2646d7130d45 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:51.381053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:51.382517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:51.382816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:51.383336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] PATH_INFO: `/v3/projects/5c56111f196c41cd9b5439ac354e0581` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:51.384632 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c56111f196c41cd9b5439ac354e0581)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:51.386948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:51.456840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c56111f196c41cd9b5439ac354e0581', 'request_id': 'req-1934ba17-d69f-4029-8c71-30d556b2aaf9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.464298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c56111f196c41cd9b5439ac354e0581', 'request_id': 'req-1934ba17-d69f-4029-8c71-30d556b2aaf9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.471731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c56111f196c41cd9b5439ac354e0581', 'request_id': 'req-1934ba17-d69f-4029-8c71-30d556b2aaf9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.483384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] The token cache is being invalidate because project 5c56111f196c41cd9b5439ac354e0581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:51.483731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.484360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.487671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1021/2023] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:51 2021] DELETE /identity/v3/projects/5c56111f196c41cd9b5439ac354e0581 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:51.490199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:51.501388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a683-1e12-4ebc-81b4-fae240fd24f0 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:51.563296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:51.564228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:51.564609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:51.566578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] PATH_INFO: `/v3/users/099e566a049f4163a3acc2420d19c96c` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:51.567942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099e566a049f4163a3acc2420d19c96c)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:51.570132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:51.623511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099e566a049f4163a3acc2420d19c96c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.632953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099e566a049f4163a3acc2420d19c96c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.633552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099e566a049f4163a3acc2420d19c96c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.651017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099e566a049f4163a3acc2420d19c96c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.666256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099e566a049f4163a3acc2420d19c96c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:51.673271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1003/2024] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:51 2021] DELETE /identity/v3/users/099e566a049f4163a3acc2420d19c96c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:51.984567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:51.986336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.005303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934ba17-d69f-4029-8c71-30d556b2aaf9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.079700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.081179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.090265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.091531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.091667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.092283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] PATH_INFO: `/v3/projects/9e206304430b44b2a69c17e370fc36ac` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.097458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e206304430b44b2a69c17e370fc36ac)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.099532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.152062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7430fbe-4b98-479d-ae30-5e0d11e0f390 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.160010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e206304430b44b2a69c17e370fc36ac', 'request_id': 'req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.168157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e206304430b44b2a69c17e370fc36ac', 'request_id': 'req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.177588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e206304430b44b2a69c17e370fc36ac', 'request_id': 'req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.190454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] The token cache is being invalidate because project 9e206304430b44b2a69c17e370fc36ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:52.190787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.191567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8b7fb60a-d341-442a-a6b3-f8aa89f8b308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.193902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1022/2025] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:51 2021] DELETE /identity/v3/projects/9e206304430b44b2a69c17e370fc36ac => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:52.199837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc43db-f67c-4252-8ed4-dab24ec0aa6b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.204259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc43db-f67c-4252-8ed4-dab24ec0aa6b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.204259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc43db-f67c-4252-8ed4-dab24ec0aa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.236432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.237368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.237819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.238249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] PATH_INFO: `/v3/users/6304e74c996e40a18439e9a2dab1360c` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.239721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6304e74c996e40a18439e9a2dab1360c)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.239970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-29dc43db-f67c-4252-8ed4-dab24ec0aa6b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:52.241192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-29dc43db-f67c-4252-8ed4-dab24ec0aa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.242591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.249886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1023/2026] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:52.272933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.273308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.273604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.300104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:52.301655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.312505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1024/2027] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:52.317200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.332384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6304e74c996e40a18439e9a2dab1360c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.332509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bec3ff-c254-4862-ab43-491200379384 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.335266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.336059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.336354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.337072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.337912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:52.338056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6304e74c996e40a18439e9a2dab1360c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.338476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.338733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6304e74c996e40a18439e9a2dab1360c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.340129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.350976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6304e74c996e40a18439e9a2dab1360c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.352165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1025/2028] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:57:52.356443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.358757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-64ac997f-c19f-4106-87d2-ad1883f9a272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6304e74c996e40a18439e9a2dab1360c'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:52.365590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1004/2029] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:52 2021] DELETE /identity/v3/users/6304e74c996e40a18439e9a2dab1360c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:52.367198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c5dd6-45e0-4503-b9fa-e588b72bf922 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.370132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.370425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.370706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.395040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:52.396271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.423578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.424276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.424563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.424845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.425548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.427465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.457916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1026/2030] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:52.458135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1005/2031] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:52.459042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.460725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.466263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.467568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.522039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81754245-f59f-43fe-a5d4-cba430832091 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.522295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664cc82-42c4-43ae-9fce-1f65ff1c4b84 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.527173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.527815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.528108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.528916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.529630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.531598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.553447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1027/2032] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:52.559970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.569961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388d993-7c11-4568-b187-2a17ee425f3a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.575371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.576277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.576570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.576846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.577651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.579328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.581097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.581747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.582107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.582383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.593125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1028/2033] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:52.595643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.597163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.604824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.608617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1006/2034] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:52.617885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817af50-ba5d-4584-b542-e50184461aa0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.622863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b7a49-cec7-4ae9-8507-bb49423e10fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.623536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7a49-cec7-4ae9-8507-bb49423e10fa admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.623864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7a49-cec7-4ae9-8507-bb49423e10fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.624148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b7a49-cec7-4ae9-8507-bb49423e10fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.624898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b7a49-cec7-4ae9-8507-bb49423e10fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.626489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b7a49-cec7-4ae9-8507-bb49423e10fa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.637314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1029/2035] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:52.641328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.652162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205a201-c129-4c8e-91ac-dcbe5e61f477 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.657764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.658656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.658945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.659223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] PATH_INFO: `/v3/projects/a3e74d01c77f4c8db178bd128fed4807/users/7f462a7b9d7842fab7d339e4f31f6979/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.675896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e74d01c77f4c8db178bd128fed4807, user_id=7f462a7b9d7842fab7d339e4f31f6979, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.678697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.692418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1007/2036] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:52 2021] PUT /identity/v3/projects/a3e74d01c77f4c8db178bd128fed4807/users/7f462a7b9d7842fab7d339e4f31f6979/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:52.702610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.702899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.703179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.730360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] MFA Rules not processed for user `7f462a7b9d7842fab7d339e4f31f6979`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:52.732324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:52.801441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1030/2037] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:52.806816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.878503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42baaf2b-9e06-4ca7-b287-472f1d0d9ddd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.883709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:52.884125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:52.884407 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:52.884685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:52.885424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:52.887325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:52.915282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1008/2038] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:52.920551 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.932064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443f535-3a15-4483-aece-9acc193cec4b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:52.981625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:52.985223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:53.028465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.030583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.030874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.031203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.032163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.034078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.056491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1031/2039] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:52 2021] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:53.061227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.071496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0f60-2fe5-457a-8824-0db5db88c74d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.076171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bd6b9-ebab-4b65-a08c-84e14de29f8c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.076844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.077583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.077940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.078315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.079128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.080838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.081006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.082006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.082448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.082554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] PATH_INFO: `/v3/projects/f41f5f58bfb94802bdc4d0baeb8bac44` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.088350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41f5f58bfb94802bdc4d0baeb8bac44)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.090382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.092205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1032/2040] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:53.096029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.106400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340594-196b-4ce1-9ee2-fe1226b1558c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.114701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.116110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.116469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.116817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.117648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.119648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.131439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1033/2041] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:53.135832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.146207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc689c45-c4d3-4d5a-b825-3a2c56ae888c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.156982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41f5f58bfb94802bdc4d0baeb8bac44', 'request_id': 'req-05c45180-1c80-426a-8f7a-ac3023ce9bf7'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.163304 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41f5f58bfb94802bdc4d0baeb8bac44', 'request_id': 'req-05c45180-1c80-426a-8f7a-ac3023ce9bf7'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.174021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41f5f58bfb94802bdc4d0baeb8bac44', 'request_id': 'req-05c45180-1c80-426a-8f7a-ac3023ce9bf7'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.184376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] The token cache is being invalidate because project f41f5f58bfb94802bdc4d0baeb8bac44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:53.185256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.185932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.187479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1009/2042] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:52 2021] DELETE /identity/v3/projects/f41f5f58bfb94802bdc4d0baeb8bac44 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:53.191284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.192597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:53.204245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df766d7-cf24-47df-aebe-e47332fa2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.205167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df766d7-cf24-47df-aebe-e47332fa2b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.205504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df766d7-cf24-47df-aebe-e47332fa2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.205789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df766d7-cf24-47df-aebe-e47332fa2b18 admin admin] PATH_INFO: `/v3/projects/ab0cc045ecad4a08aee4f25af139853c/users/d813f49c3dc54d41b6d5059193e6a6a5/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.221573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df766d7-cf24-47df-aebe-e47332fa2b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0cc045ecad4a08aee4f25af139853c, user_id=d813f49c3dc54d41b6d5059193e6a6a5, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.223768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df766d7-cf24-47df-aebe-e47332fa2b18 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.239217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1034/2043] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:53 2021] PUT /identity/v3/projects/ab0cc045ecad4a08aee4f25af139853c/users/d813f49c3dc54d41b6d5059193e6a6a5/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:53.249961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.250738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.250738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.261490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45180-1c80-426a-8f7a-ac3023ce9bf7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.282532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] MFA Rules not processed for user `d813f49c3dc54d41b6d5059193e6a6a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:53.283822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:53.330117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.331003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.331290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.331571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] PATH_INFO: `/v3/users/63f9333a34e346899d098a173b62f37b` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.333130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f9333a34e346899d098a173b62f37b)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.335063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.355968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1035/2044] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:53 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:53.360556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.361920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:53.376450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c19f7-d2cd-4264-95bd-59331b46da94 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.382022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.385203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.385399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f9333a34e346899d098a173b62f37b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.385742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.386084 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.386886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.388921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.393252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f9333a34e346899d098a173b62f37b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.394231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f9333a34e346899d098a173b62f37b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.409353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f9333a34e346899d098a173b62f37b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.416844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f9333a34e346899d098a173b62f37b'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:53.418491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1036/2045] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:53 2021] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:53.422601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.423653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1010/2046] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:53 2021] DELETE /identity/v3/users/63f9333a34e346899d098a173b62f37b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:53.426943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:53.506726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd8ef0-ff28-4323-b514-5ba350cd2eb2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.589623 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.590430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.591345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.591762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.592749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.596119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.631021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1037/2047] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:53 2021] POST /identity/v3/users => generated 295 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:53.634995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.648429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53708-205d-4003-810b-d3662970fe25 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.654817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.655514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.655830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.656119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.657138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.658759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.677499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1011/2048] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:53.679411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.689713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f442a-b4af-4aa1-8a0e-40f38532f495 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.694913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.695862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.696157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.696439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] PATH_INFO: `/v3/projects/d27e632e187a48ec9fad76c54cf40c95/users/c4a6655a8d154461be2ec6ac49f9f8e8/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.719704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27e632e187a48ec9fad76c54cf40c95, user_id=c4a6655a8d154461be2ec6ac49f9f8e8, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.723329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.738745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1038/2049] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:53 2021] PUT /identity/v3/projects/d27e632e187a48ec9fad76c54cf40c95/users/c4a6655a8d154461be2ec6ac49f9f8e8/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:53.742634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.756534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ae58c-f72a-4aa7-b692-b72449107a2c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.793192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.795387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:53.893275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.893977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.894454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.894742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.894846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39de419-80b2-4006-a552-ad315e9b0b88 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.898098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.900872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.918167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.919188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.919807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.920224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] PATH_INFO: `/v3/projects/b3473cff065a4fa5b113f0878105e734` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.923995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1012/2050] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:53 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:53.924929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3473cff065a4fa5b113f0878105e734)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.927882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.929963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:53.950825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2179cf3-b1a3-4ff9-936e-0c7b9cf91876 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:53.960444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b31f3c-c8a6-4e3b-adc6-cfe0cdf3184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:53.961695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b31f3c-c8a6-4e3b-adc6-cfe0cdf3184a admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.961839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b31f3c-c8a6-4e3b-adc6-cfe0cdf3184a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.962278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b31f3c-c8a6-4e3b-adc6-cfe0cdf3184a admin admin] PATH_INFO: `/v3/projects/d27e632e187a48ec9fad76c54cf40c95/users/c4a6655a8d154461be2ec6ac49f9f8e8/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:53.964841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b31f3c-c8a6-4e3b-adc6-cfe0cdf3184a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d27e632e187a48ec9fad76c54cf40c95, user_id=c4a6655a8d154461be2ec6ac49f9f8e8, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:53.968501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b31f3c-c8a6-4e3b-adc6-cfe0cdf3184a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:53.985308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1013/2051] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:53 2021] PUT /identity/v3/projects/d27e632e187a48ec9fad76c54cf40c95/users/c4a6655a8d154461be2ec6ac49f9f8e8/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:53.997080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:53.997608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:53.998149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.017857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3473cff065a4fa5b113f0878105e734', 'request_id': 'req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.028228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3473cff065a4fa5b113f0878105e734', 'request_id': 'req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.039933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3473cff065a4fa5b113f0878105e734', 'request_id': 'req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.046360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] MFA Rules not processed for user `c4a6655a8d154461be2ec6ac49f9f8e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:54.048084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.053205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] The token cache is being invalidate because project b3473cff065a4fa5b113f0878105e734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:54.053510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.054187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.055773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1039/2052] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:53 2021] DELETE /identity/v3/projects/b3473cff065a4fa5b113f0878105e734 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:54.060153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:54.061534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.131679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1014/2053] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:53 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:54.142057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b35b1-1e9e-432f-9175-486ce1a4fb19 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:54.142359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:54.144120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.148231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:54.148789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:54.149240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:54.149631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] PATH_INFO: `/v3/users/c164a2378d7f4ea9ba78976650e2d538` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.151490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c164a2378d7f4ea9ba78976650e2d538)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:54.153685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:54.218905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a14a5f-14cb-4631-ac59-940853da9ce8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:54.221002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c164a2378d7f4ea9ba78976650e2d538'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.223225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:54.223763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:54.224052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:54.224331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.226295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.235927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c164a2378d7f4ea9ba78976650e2d538'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.237344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c164a2378d7f4ea9ba78976650e2d538'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.238221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c164a2378d7f4ea9ba78976650e2d538'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.251298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c164a2378d7f4ea9ba78976650e2d538'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.282526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1040/2054] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:54 2021] DELETE /identity/v3/users/c164a2378d7f4ea9ba78976650e2d538 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:54.284216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:54.286017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.312459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:54.314993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d31a91-c10b-488e-ae6e-babc68ebc86c service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:54.341036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1015/2055] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:54 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:54.391216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f1dee-c76f-40de-9338-80a43517f382 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:54.396715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:54.406178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:54.406178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:54.406178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] PATH_INFO: `/v3/users/592dc580513e4330b1e64575920f0a8e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.406178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=592dc580513e4330b1e64575920f0a8e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:54.406178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:54.514395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592dc580513e4330b1e64575920f0a8e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.541811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592dc580513e4330b1e64575920f0a8e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.542774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592dc580513e4330b1e64575920f0a8e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.543757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592dc580513e4330b1e64575920f0a8e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.561597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592dc580513e4330b1e64575920f0a8e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.580486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1041/2056] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:54 2021] DELETE /identity/v3/users/592dc580513e4330b1e64575920f0a8e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:54.590529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc879cd-d4bf-4cd7-ae20-4caa2a3a92c6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:54.590890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc879cd-d4bf-4cd7-ae20-4caa2a3a92c6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:54.591266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc879cd-d4bf-4cd7-ae20-4caa2a3a92c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.611786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-acc879cd-d4bf-4cd7-ae20-4caa2a3a92c6 None None] MFA Rules not processed for user `2dc41f90272e4a549aad1634f08342a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:54.613113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-acc879cd-d4bf-4cd7-ae20-4caa2a3a92c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.695802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1016/2057] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:54 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:54.779845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:54.781951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:54.874540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259d9c5-3948-4371-bc7d-b098c974a7df admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:54.879225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:54.880234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:54.880877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:54.880877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] PATH_INFO: `/v3/projects/dbfe40390d9e4d338afb42e957fcd48a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.882552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfe40390d9e4d338afb42e957fcd48a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:54.884141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:54.933098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfe40390d9e4d338afb42e957fcd48a', 'request_id': 'req-7a68f487-e28e-422b-a183-ae39390f2987'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.942532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfe40390d9e4d338afb42e957fcd48a', 'request_id': 'req-7a68f487-e28e-422b-a183-ae39390f2987'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.950009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfe40390d9e4d338afb42e957fcd48a', 'request_id': 'req-7a68f487-e28e-422b-a183-ae39390f2987'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.963365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] The token cache is being invalidate because project dbfe40390d9e4d338afb42e957fcd48a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:54.963684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.964409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:54.966120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1042/2058] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:54 2021] DELETE /identity/v3/projects/dbfe40390d9e4d338afb42e957fcd48a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:54.975381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1301b-f41b-410d-ad9c-258bc7edef1c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:54.975872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1301b-f41b-410d-ad9c-258bc7edef1c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:54.976220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1301b-f41b-410d-ad9c-258bc7edef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:54.983295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:54.984702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.005076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7fb1301b-f41b-410d-ad9c-258bc7edef1c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:55.006821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7fb1301b-f41b-410d-ad9c-258bc7edef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.096829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68f487-e28e-422b-a183-ae39390f2987 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.097660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1017/2059] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:55.099062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.099414 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.100484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.102555 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.103596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.103957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.104242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] PATH_INFO: `/v3/projects/27238c465f3941fb932e099dca430763` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.105767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27238c465f3941fb932e099dca430763)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.108196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.123210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:55.124448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.133280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1018/2060] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:55.138248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.147988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f1f16-3905-48d0-af57-d5abe3fbe632 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.154220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.154897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.155186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.155467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.156420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:55.157657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.159305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.169722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27238c465f3941fb932e099dca430763', 'request_id': 'req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:55.172521 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1019/2061] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:55.176722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.181117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27238c465f3941fb932e099dca430763', 'request_id': 'req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:55.190353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27238c465f3941fb932e099dca430763', 'request_id': 'req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:55.191219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a401ee-c8af-4731-98a4-5f5915ddd8fd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.203346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] The token cache is being invalidate because project 27238c465f3941fb932e099dca430763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:55.203735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:55.204506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b3844f67-f6df-4bd6-a41a-2eb0c8ff0adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:55.207711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1043/2062] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:54 2021] DELETE /identity/v3/projects/27238c465f3941fb932e099dca430763 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:55.212485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e1527-37ae-4261-8518-a6710178d3bd None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.212775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e1527-37ae-4261-8518-a6710178d3bd None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.213081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e1527-37ae-4261-8518-a6710178d3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.241475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a49e1527-37ae-4261-8518-a6710178d3bd None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:55.242574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a49e1527-37ae-4261-8518-a6710178d3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.283947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.285612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.287277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.287562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.288434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.290419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.323770 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1044/2063] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:55.332565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.332865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.333150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.345384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1020/2064] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:55.351018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.352989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.353910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:55.355203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.460311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea92b-dfb9-493d-9967-8b772b1cd42e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.470804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1045/2065] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:55.475779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.475952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.476566 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.476860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.477147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.477981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.480001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.487167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d10bb1-10d2-47d8-aea8-e7b01466294b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.492725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.493358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.493833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.494224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.495493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:55.495963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.497913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.510179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1021/2066] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:57:55.515343 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.522214 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1046/2067] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:57:55.526544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.527883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86b5ca-ed5b-48a0-8280-029413d25abd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.533122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.533813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.534096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.534378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.535275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.537569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.544587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c4f4a-cbcf-49ab-9b15-6bed51c66b44 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.550716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.551557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1022/2068] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:55.554614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.554987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.555357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.556192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.557206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.558405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.576097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c27e06-934f-49cb-9c6e-105cded16f04 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.589837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.590619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.590988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.591360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.592464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.594377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.605603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1047/2069] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:55.612360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.617633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1023/2070] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:55.621832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.633058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d910d5-1fcf-42d7-9872-a067e0fff904 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.677779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf5c33-b36a-4143-9387-d1b78218bd0d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.683502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.684238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.685222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.685662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.686390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.688373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.693864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719bb23-45f1-40b9-8680-3dabe971e9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.694719 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719bb23-45f1-40b9-8680-3dabe971e9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.695002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719bb23-45f1-40b9-8680-3dabe971e9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.695286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719bb23-45f1-40b9-8680-3dabe971e9b4 admin admin] PATH_INFO: `/v3/projects/0c36edb927ea41e98287b874e1e4d9de/users/8c0d63a509fb4169b0bfc72e01a8575d/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.712858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719bb23-45f1-40b9-8680-3dabe971e9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c36edb927ea41e98287b874e1e4d9de, user_id=8c0d63a509fb4169b0bfc72e01a8575d, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.716019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719bb23-45f1-40b9-8680-3dabe971e9b4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.719749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1048/2071] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:55.723868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.734173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1024/2072] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:55 2021] PUT /identity/v3/projects/0c36edb927ea41e98287b874e1e4d9de/users/8c0d63a509fb4169b0bfc72e01a8575d/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:55.735968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d71b0-59bc-4b37-ab0f-8569db8de936 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.749208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.749498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.752657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.784068 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] MFA Rules not processed for user `8c0d63a509fb4169b0bfc72e01a8575d`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:55.785276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:55.817020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.817934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.818231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.818519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.819424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.821373 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.833917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1049/2073] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:55.840705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.853086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49e37-ec38-428b-bcb9-e3876094c64f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.858556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.859234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.859524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.859849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.860622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.862210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.872871 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1025/2074] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:55.877518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1050/2075] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:55 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:55.877927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.878671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.889852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab3f0-5814-4e7b-80f5-0df8aa85c1be admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.892587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6628bd-9e74-46e2-953a-b13724383402 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:55.894841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a54a4-db78-4fe4-938b-1dfb6eb33b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.895907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a54a4-db78-4fe4-938b-1dfb6eb33b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.896092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a54a4-db78-4fe4-938b-1dfb6eb33b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.896487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a54a4-db78-4fe4-938b-1dfb6eb33b89 admin admin] PATH_INFO: `/v3/projects/acf465ea6c244dcaa76ca3817fc6801f/users/07d92b2e7b1b46f6916c335b25a44ecf/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.898039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:55.898664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.898967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.899395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:55.900157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.902425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.930574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a54a4-db78-4fe4-938b-1dfb6eb33b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acf465ea6c244dcaa76ca3817fc6801f, user_id=07d92b2e7b1b46f6916c335b25a44ecf, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:55.936355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a54a4-db78-4fe4-938b-1dfb6eb33b89 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:55.941255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1026/2076] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:55.947220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:55.958618 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1051/2077] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:55 2021] PUT /identity/v3/projects/acf465ea6c244dcaa76ca3817fc6801f/users/07d92b2e7b1b46f6916c335b25a44ecf/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:55.964052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:55.964349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:55.964654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.014894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:56.017924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:56.062236 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd44e-af26-4225-9e36-81731438f442 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.139313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1052/2078] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:57:56.140872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.142425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:56.195779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.198829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.199119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.201485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.208460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.214828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.222943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd6efd-aec7-49e6-9e0a-eccb32f3052c None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.227952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.228969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.229492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.230131 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.233059 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:56.261553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1027/2079] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:55 2021] POST /identity/v3/users => generated 300 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:56.266738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.272115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:56.328104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.329589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.353700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1053/2080] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:56 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:56.354752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.378067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f985de-7746-4ff3-8e31-36786ef38025 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.389807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.391537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.391924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.392188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.393640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.399183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.414003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1054/2081] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:56 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:56.417915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.438661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b120ff-bfc0-450d-83b1-a9a9060e5414 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.444190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.445186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.445458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.445793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] PATH_INFO: `/v3/projects/1a2eaed625824707b67118cffe00f534/users/fc1cc276867b4d869ab91038d8e34fbf/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.467344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2eaed625824707b67118cffe00f534, user_id=fc1cc276867b4d869ab91038d8e34fbf, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.470303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.489743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1055/2082] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:56 2021] PUT /identity/v3/projects/1a2eaed625824707b67118cffe00f534/users/fc1cc276867b4d869ab91038d8e34fbf/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:56.493880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.538642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d0752-c99f-40e7-84ec-a8d111d5129e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.602293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40ca33-a32b-4542-9cc4-0b907fb0e708 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.614136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.615468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.617046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.617440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.619564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.620385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b2e6c-88b8-4242-9c75-2edfb4a912e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.623663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2e6c-88b8-4242-9c75-2edfb4a912e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.624075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2e6c-88b8-4242-9c75-2edfb4a912e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.624365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b2e6c-88b8-4242-9c75-2edfb4a912e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.625193 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.649854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1056/2083] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:56 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:56.653923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2e6c-88b8-4242-9c75-2edfb4a912e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.653923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b2e6c-88b8-4242-9c75-2edfb4a912e0 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.654793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.674330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88153c08-a8e9-4541-9fff-49e8af3b51f0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.677326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1028/2084] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:56.681726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.682783 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.683076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.683364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] PATH_INFO: `/v3/projects/1a2eaed625824707b67118cffe00f534/users/fc1cc276867b4d869ab91038d8e34fbf/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.689761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2eaed625824707b67118cffe00f534, user_id=fc1cc276867b4d869ab91038d8e34fbf, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:56.693218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:56.707047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1057/2085] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:56 2021] PUT /identity/v3/projects/1a2eaed625824707b67118cffe00f534/users/fc1cc276867b4d869ab91038d8e34fbf/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:56.720618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.721006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.721299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:56.757846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] MFA Rules not processed for user `fc1cc276867b4d869ab91038d8e34fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:56.759093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:56.856877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1029/2086] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:56 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:56.869960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:56.871734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:56.985556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab9c1a-d1b8-4f72-9b57-ab7a4f13a8aa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:56.989765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:56.990413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:56.990707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:56.990988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:57.002258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:57.003875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:57.022538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1058/2087] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:56 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:57.188475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:57.285600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:57.291725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515377-326a-47ff-998e-19bc9bb5e485 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:57.297216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:57.297967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d40fe-76bc-4600-85ca-b2c030e13d13 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:57.298309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:57.298595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:57.299076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] PATH_INFO: `/v3/users/8c0d63a509fb4169b0bfc72e01a8575d` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:57.301162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c0d63a509fb4169b0bfc72e01a8575d)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:57.303741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:57.308258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:57.309097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:57.310088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:57.310514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:57.312938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:57.365231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c0d63a509fb4169b0bfc72e01a8575d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:57.373254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c0d63a509fb4169b0bfc72e01a8575d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:57.374173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c0d63a509fb4169b0bfc72e01a8575d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:57.392375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c0d63a509fb4169b0bfc72e01a8575d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:57.393432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:57.395228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664eab73-395d-4e20-a470-4a248d9add49 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:57.401892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c0d63a509fb4169b0bfc72e01a8575d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:57.405945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1059/2088] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:57 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 04:57:57.409051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1030/2089] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:57 2021] DELETE /identity/v3/users/8c0d63a509fb4169b0bfc72e01a8575d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:57.414861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:57.415159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:57.416171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:57.438153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:57.439514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:57.559021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1060/2090] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:57.567044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:57.568480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:57.633596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecb593-d602-4fa8-9ffc-ef68078a96ab admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:57.637477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:57.638248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:57.638687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:57.639033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:57.650156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:57.651590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:57.661418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1031/2091] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:57:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:57:57.936010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:57.938470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:57.981075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a5794-f8ac-4f61-a18a-4d4264402f78 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:57.998798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:57.999903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:58.000201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:58.000622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] PATH_INFO: `/v3/projects/0c36edb927ea41e98287b874e1e4d9de` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:58.003007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c36edb927ea41e98287b874e1e4d9de)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:58.004999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:58.101175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c36edb927ea41e98287b874e1e4d9de', 'request_id': 'req-b5558ce9-776c-41c7-98b6-c661465db154'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.109971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c36edb927ea41e98287b874e1e4d9de', 'request_id': 'req-b5558ce9-776c-41c7-98b6-c661465db154'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.118518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c36edb927ea41e98287b874e1e4d9de', 'request_id': 'req-b5558ce9-776c-41c7-98b6-c661465db154'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.132036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] The token cache is being invalidate because project 0c36edb927ea41e98287b874e1e4d9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:58.132325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.133038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.134590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1061/2092] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:57 2021] DELETE /identity/v3/projects/0c36edb927ea41e98287b874e1e4d9de => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:58.141209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:58.149185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a465-e37e-4f24-8c3d-04506e7bcca5 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:58.212043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:58.212931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:58.213262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:58.214984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] PATH_INFO: `/v3/users/fc1cc276867b4d869ab91038d8e34fbf` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:58.216606 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1cc276867b4d869ab91038d8e34fbf)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:58.218783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:58.270469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1cc276867b4d869ab91038d8e34fbf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.277877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1cc276867b4d869ab91038d8e34fbf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.279081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1cc276867b4d869ab91038d8e34fbf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.297248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1cc276867b4d869ab91038d8e34fbf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.306300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00d01798-b164-4303-9dc5-08cfc49b2f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1cc276867b4d869ab91038d8e34fbf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:58.319338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1032/2093] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:57:58 2021] DELETE /identity/v3/users/fc1cc276867b4d869ab91038d8e34fbf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:59.005105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.014846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:59.056027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5558ce9-776c-41c7-98b6-c661465db154 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.140218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.141117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.141402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.141681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] PATH_INFO: `/v3/projects/1a2eaed625824707b67118cffe00f534` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.142885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2eaed625824707b67118cffe00f534)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.144861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.205352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2eaed625824707b67118cffe00f534', 'request_id': 'req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:59.237092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2eaed625824707b67118cffe00f534', 'request_id': 'req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:59.274364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2eaed625824707b67118cffe00f534', 'request_id': 'req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:59.295483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] The token cache is being invalidate because project 1a2eaed625824707b67118cffe00f534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:57:59.296061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:59.296945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f221ce75-e168-4ed6-bbf1-5d333af9cf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:57:59.300927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1062/2094] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:57:59 2021] DELETE /identity/v3/projects/1a2eaed625824707b67118cffe00f534 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:57:59.306315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673601d6-c335-46eb-a789-138725e1e312 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.306805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673601d6-c335-46eb-a789-138725e1e312 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.306879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673601d6-c335-46eb-a789-138725e1e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.333789 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-673601d6-c335-46eb-a789-138725e1e312 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:59.335028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-673601d6-c335-46eb-a789-138725e1e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:59.414002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1033/2095] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:59.422716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.422949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.423231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.442429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:59.443697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:57:59.452973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1063/2096] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:57:59.457710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673601d6-c335-46eb-a789-138725e1e312 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.470337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673601d6-c335-46eb-a789-138725e1e312 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.475025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.475725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.476202 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.476327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.477163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:57:59.477649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.479469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.495907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1034/2097] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:57:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 04:57:59.498893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.508410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fa480-088a-45ba-9cb8-71e8b338e195 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.518251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.518948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.519239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.519521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.521103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.523120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.571788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1064/2098] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:57:59 2021] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:59.576030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.586409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbf438-b9ef-4c7d-9160-e41f546a7bb2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.653430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.654142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.654483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.654761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.655497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.657956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.683754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1035/2099] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:57:59 2021] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:57:59.689909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.709393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6867b-0d15-4445-8daa-9e86dff69904 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.715435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.716192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.716584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.717183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.718301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.721445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.736998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1065/2100] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:59 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:57:59.741524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.755292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448453d-6668-4320-98d7-d578e3b76db9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.766016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1610cb-740b-4c33-9dc3-b0b949aac567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.766869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1610cb-740b-4c33-9dc3-b0b949aac567 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.767228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1610cb-740b-4c33-9dc3-b0b949aac567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.767568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1610cb-740b-4c33-9dc3-b0b949aac567 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.768488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1610cb-740b-4c33-9dc3-b0b949aac567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.770243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1610cb-740b-4c33-9dc3-b0b949aac567 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.781872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1036/2101] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:57:59 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:57:59.785858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:57:59.796582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5082a-a5bf-41fa-8cc7-94d3606743ce admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:57:59.802720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:57:59.803727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.804086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.804438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] PATH_INFO: `/v3/projects/14a053fcef3c4657bf6098a6cc2f88d6/users/690b1f5b904b4fc6ae16a63cc8e2eb73/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.820583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a053fcef3c4657bf6098a6cc2f88d6, user_id=690b1f5b904b4fc6ae16a63cc8e2eb73, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:57:59.824646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:57:59.840747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1066/2102] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:57:59 2021] PUT /identity/v3/projects/14a053fcef3c4657bf6098a6cc2f88d6/users/690b1f5b904b4fc6ae16a63cc8e2eb73/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:57:59.851672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:57:59.852061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:57:59.852404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:57:59.898805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] MFA Rules not processed for user `690b1f5b904b4fc6ae16a63cc8e2eb73`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:57:59.900327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:00.020051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1037/2103] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:57:59 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:00.049960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:00.052133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:00.157578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb7931-c152-4020-b267-80ce2ca7d6e6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:00.162334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41496224-11ba-4d02-9c3b-1230ce13d93c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:00.163205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496224-11ba-4d02-9c3b-1230ce13d93c service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:00.163696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496224-11ba-4d02-9c3b-1230ce13d93c service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:00.164125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41496224-11ba-4d02-9c3b-1230ce13d93c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:00.174098 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496224-11ba-4d02-9c3b-1230ce13d93c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:00.184015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41496224-11ba-4d02-9c3b-1230ce13d93c service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:00.193786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1067/2104] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:00 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:01.658972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:01.660451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:01.725445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea3d23-2eec-4c1d-8810-ea3f2bbd1dc3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:01.730004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:01.731028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:01.731495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:01.731892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] PATH_INFO: `/v3/users/7f462a7b9d7842fab7d339e4f31f6979` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:01.733184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f462a7b9d7842fab7d339e4f31f6979)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:01.735077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:01.779186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f462a7b9d7842fab7d339e4f31f6979'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:01.787149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f462a7b9d7842fab7d339e4f31f6979'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:01.787869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f462a7b9d7842fab7d339e4f31f6979'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:01.799481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f462a7b9d7842fab7d339e4f31f6979'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:01.807292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f462a7b9d7842fab7d339e4f31f6979'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:01.815294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1038/2105] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:58:01 2021] DELETE /identity/v3/users/7f462a7b9d7842fab7d339e4f31f6979 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:01.819840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76870f5-7bba-4e2c-a179-58c042174954 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:01.820306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76870f5-7bba-4e2c-a179-58c042174954 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:01.820396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76870f5-7bba-4e2c-a179-58c042174954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:01.883369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b76870f5-7bba-4e2c-a179-58c042174954 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:01.884684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b76870f5-7bba-4e2c-a179-58c042174954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:02.021252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1068/2106] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:02.032139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:02.033665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:02.114021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1619a-a8b2-4fd6-9f6b-2848e114ed8c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:02.117964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:02.118679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:02.118890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:02.119166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:02.132793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:02.134245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:02.145942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1039/2107] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:02.254578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:02.255013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:02.255395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:02.288431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] MFA Rules not processed for user `0952832b106844dea05a888f4266dd95`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:02.292758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:02.366054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1069/2108] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:03.338947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:03.341207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:03.369210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6e40a-bb3b-418d-bb2c-47afca487ce3 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:03.376281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:03.378089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:03.378416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:03.379042 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] PATH_INFO: `/v3/projects/a3e74d01c77f4c8db178bd128fed4807` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:03.380622 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e74d01c77f4c8db178bd128fed4807)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:03.383148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:03.446877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e74d01c77f4c8db178bd128fed4807', 'request_id': 'req-6b0e9b16-5b7b-449c-90da-0942b2e20511'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.456183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e74d01c77f4c8db178bd128fed4807', 'request_id': 'req-6b0e9b16-5b7b-449c-90da-0942b2e20511'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.470081 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e74d01c77f4c8db178bd128fed4807', 'request_id': 'req-6b0e9b16-5b7b-449c-90da-0942b2e20511'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.493210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] The token cache is being invalidate because project a3e74d01c77f4c8db178bd128fed4807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:58:03.493516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.495802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.502220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:03.504733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1040/2109] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:58:03 2021] DELETE /identity/v3/projects/a3e74d01c77f4c8db178bd128fed4807 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:03.521585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17154a3f-d0b0-4f16-8f61-bbc28feb1d36 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:03.675061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:03.676216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:03.677182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:03.677559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] PATH_INFO: `/v3/users/d813f49c3dc54d41b6d5059193e6a6a5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:03.679716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d813f49c3dc54d41b6d5059193e6a6a5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:03.682307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:03.782156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd813f49c3dc54d41b6d5059193e6a6a5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.806379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd813f49c3dc54d41b6d5059193e6a6a5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.807400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd813f49c3dc54d41b6d5059193e6a6a5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.813682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd813f49c3dc54d41b6d5059193e6a6a5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.829849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd813f49c3dc54d41b6d5059193e6a6a5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:03.854523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1070/2110] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:58:03 2021] DELETE /identity/v3/users/d813f49c3dc54d41b6d5059193e6a6a5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:04.261315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:04.263538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:04.280535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e9b16-5b7b-449c-90da-0942b2e20511 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:04.394092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:04.402128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:04.402791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:04.403687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] PATH_INFO: `/v3/projects/ab0cc045ecad4a08aee4f25af139853c` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:04.405117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0cc045ecad4a08aee4f25af139853c)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:04.408029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:04.496416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0cc045ecad4a08aee4f25af139853c', 'request_id': 'req-e50ff1ac-370e-435c-a76e-e3900f94af59'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.504916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0cc045ecad4a08aee4f25af139853c', 'request_id': 'req-e50ff1ac-370e-435c-a76e-e3900f94af59'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.513742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0cc045ecad4a08aee4f25af139853c', 'request_id': 'req-e50ff1ac-370e-435c-a76e-e3900f94af59'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.525644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] The token cache is being invalidate because project ab0cc045ecad4a08aee4f25af139853c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:58:04.525856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.527017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e50ff1ac-370e-435c-a76e-e3900f94af59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.529280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1041/2111] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:58:04 2021] DELETE /identity/v3/projects/ab0cc045ecad4a08aee4f25af139853c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:04.536083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:04.539399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:04.562302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500d363-bf26-4b5c-b543-d44f71e0049f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:04.675901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:04.677285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:04.677733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:04.678164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] PATH_INFO: `/v3/users/c4a6655a8d154461be2ec6ac49f9f8e8` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:04.679600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a6655a8d154461be2ec6ac49f9f8e8)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:04.681934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:04.774749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a6655a8d154461be2ec6ac49f9f8e8'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.790202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a6655a8d154461be2ec6ac49f9f8e8'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.791302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a6655a8d154461be2ec6ac49f9f8e8'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.792252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a6655a8d154461be2ec6ac49f9f8e8'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.815049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a6655a8d154461be2ec6ac49f9f8e8'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:04.844836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1071/2112] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:58:04 2021] DELETE /identity/v3/users/c4a6655a8d154461be2ec6ac49f9f8e8 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:04.988659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:04.988935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:04.989218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.025091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] MFA Rules not processed for user `07d92b2e7b1b46f6916c335b25a44ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:05.026399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:05.178007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1042/2113] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:04 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:05.207594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:05.209504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:05.335034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4792bb1-56c4-4ce0-b448-da1803f5caf3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:05.342362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5be725-75f4-4671-b890-7c4b8a98d82b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:05.343503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5be725-75f4-4671-b890-7c4b8a98d82b service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:05.343990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5be725-75f4-4671-b890-7c4b8a98d82b service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:05.344436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5be725-75f4-4671-b890-7c4b8a98d82b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.353943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5be725-75f4-4671-b890-7c4b8a98d82b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:05.357332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5be725-75f4-4671-b890-7c4b8a98d82b service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:05.368069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1072/2114] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:05 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:05.408452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:05.410015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:05.540074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d7a1-0f51-438e-9db0-d7c8eec09c6a None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:05.551554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:05.552777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:05.553248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:05.553705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] PATH_INFO: `/v3/projects/d27e632e187a48ec9fad76c54cf40c95` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.555207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d27e632e187a48ec9fad76c54cf40c95)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:05.557291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:05.679145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd27e632e187a48ec9fad76c54cf40c95', 'request_id': 'req-8c7a365a-2572-4ae4-aab8-e30344b23e13'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:05.689518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd27e632e187a48ec9fad76c54cf40c95', 'request_id': 'req-8c7a365a-2572-4ae4-aab8-e30344b23e13'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:05.700424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd27e632e187a48ec9fad76c54cf40c95', 'request_id': 'req-8c7a365a-2572-4ae4-aab8-e30344b23e13'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:05.713499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] The token cache is being invalidate because project d27e632e187a48ec9fad76c54cf40c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:58:05.714261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:05.715169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c7a365a-2572-4ae4-aab8-e30344b23e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:05.718259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1043/2115] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:58:05 2021] DELETE /identity/v3/projects/d27e632e187a48ec9fad76c54cf40c95 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:05.724434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:05.724902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:05.725053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.759055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:05.760766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:05.835329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1073/2116] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:05.837438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:05.837438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:05.837438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.862153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:05.863591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:05.872804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1044/2117] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:58:05.876866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:05.887986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82dc1f-4d8a-4db1-bce4-529d69f6e1c6 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:05.893388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:05.894508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:05.894631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:05.894911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.895919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:58:05.896182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:05.897817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:05.929264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1074/2118] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:58:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:58:05.930259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:05.941782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a0803-2a64-439f-8149-387ea0738b05 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:05.952083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:05.952954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:05.953926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:05.955254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:05.956235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:05.959722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:05.992736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1045/2119] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:58:05 2021] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:58:05.996509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:06.009430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597435c2-822c-4634-bc50-080a927a271e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:06.090449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:06.091202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:06.091531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:06.093274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:06.094726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:06.099932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:06.132901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1075/2120] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:58:05 2021] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:58:06.138327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:06.151853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967734f6-b71b-4bf7-a169-00ed92bf93f3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:06.158760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:06.159449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:06.159854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:06.160137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:06.160890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:06.163348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:06.180719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:06.190383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1046/2121] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:58:06 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:58:06.209215 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169925a-55ec-4641-add1-884b9b3c6a8a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:06.220997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeb4c8-2670-4a9d-b3f0-34205752fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:06.222085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb4c8-2670-4a9d-b3f0-34205752fc9a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:06.222612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb4c8-2670-4a9d-b3f0-34205752fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:06.223097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeb4c8-2670-4a9d-b3f0-34205752fc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:06.224159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeb4c8-2670-4a9d-b3f0-34205752fc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:06.226786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeb4c8-2670-4a9d-b3f0-34205752fc9a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:06.239996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1076/2122] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:58:06 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:58:06.244373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:06.257863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58413263-2e2c-4e6d-aa50-d8cae8d38fad admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:06.263605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:06.264791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:06.265194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:06.265578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] PATH_INFO: `/v3/projects/b14a97c82cce44babe2f1984d660e1ba/users/28ae260b9ca94088a315d102295b7cd8/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:06.283258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14a97c82cce44babe2f1984d660e1ba, user_id=28ae260b9ca94088a315d102295b7cd8, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:06.286642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:06.303219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1047/2123] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:58:06 2021] PUT /identity/v3/projects/b14a97c82cce44babe2f1984d660e1ba/users/28ae260b9ca94088a315d102295b7cd8/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:06.315456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d5d08-17d3-48a7-be92-dbb72d7bb02b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:06.316046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d5d08-17d3-48a7-be92-dbb72d7bb02b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:06.316587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d5d08-17d3-48a7-be92-dbb72d7bb02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:06.356438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-274d5d08-17d3-48a7-be92-dbb72d7bb02b None None] MFA Rules not processed for user `28ae260b9ca94088a315d102295b7cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:06.357805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-274d5d08-17d3-48a7-be92-dbb72d7bb02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:06.454824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1077/2124] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:06 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:06.464735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:06.468196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:06.543209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ee2e7-c4cc-42af-9377-2c216e12430d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:06.550211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:06.551366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:06.551959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:06.552442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:06.574160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:06.577770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:06.608378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1048/2125] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:06 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:08.242050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89340-d823-41f7-8255-9f844dcc49ab None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:08.242684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89340-d823-41f7-8255-9f844dcc49ab None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:08.242684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89340-d823-41f7-8255-9f844dcc49ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:08.269321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-93f89340-d823-41f7-8255-9f844dcc49ab None None] MFA Rules not processed for user `07d92b2e7b1b46f6916c335b25a44ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:08.272725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-93f89340-d823-41f7-8255-9f844dcc49ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:08.375589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1078/2126] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:08 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:31.025480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:31.026931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:31.106955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6400b9-2ea3-4984-8d5f-3a85d1349be8 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:31.111483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:31.112377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.112660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.112941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] PATH_INFO: `/v3/users/690b1f5b904b4fc6ae16a63cc8e2eb73` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.114166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690b1f5b904b4fc6ae16a63cc8e2eb73)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:31.116113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:31.160427 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690b1f5b904b4fc6ae16a63cc8e2eb73'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.167195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690b1f5b904b4fc6ae16a63cc8e2eb73'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.167880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690b1f5b904b4fc6ae16a63cc8e2eb73'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.180034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690b1f5b904b4fc6ae16a63cc8e2eb73'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.186819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690b1f5b904b4fc6ae16a63cc8e2eb73'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.192632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1049/2127] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:58:31 2021] DELETE /identity/v3/users/690b1f5b904b4fc6ae16a63cc8e2eb73 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:31.196986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.197478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.197568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.215244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:31.216605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:31.273745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1079/2128] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:31.283909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:31.285300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:31.339788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d027f-933d-4a09-b82b-92ca65fdb173 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:31.343420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd15be-02a6-4e04-bf91-5dfdafd82fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:31.344096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd15be-02a6-4e04-bf91-5dfdafd82fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.344384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd15be-02a6-4e04-bf91-5dfdafd82fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.344666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd15be-02a6-4e04-bf91-5dfdafd82fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.353420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd15be-02a6-4e04-bf91-5dfdafd82fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:31.354836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd15be-02a6-4e04-bf91-5dfdafd82fa6 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:31.364434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1050/2129] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:31.633668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:31.635088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:31.648290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9797b8c-4221-4a97-a9fe-cd5e8e0b73ea None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:31.656219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:31.657367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.657919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.658348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] PATH_INFO: `/v3/projects/14a053fcef3c4657bf6098a6cc2f88d6` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.660013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a053fcef3c4657bf6098a6cc2f88d6)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:31.662092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:31.718851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a053fcef3c4657bf6098a6cc2f88d6', 'request_id': 'req-a067f276-0358-4473-972a-ff4a1c64bf1a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.727834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a053fcef3c4657bf6098a6cc2f88d6', 'request_id': 'req-a067f276-0358-4473-972a-ff4a1c64bf1a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.735745 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a053fcef3c4657bf6098a6cc2f88d6', 'request_id': 'req-a067f276-0358-4473-972a-ff4a1c64bf1a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.748123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] The token cache is being invalidate because project 14a053fcef3c4657bf6098a6cc2f88d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:58:31.748398 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.760177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a067f276-0358-4473-972a-ff4a1c64bf1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:31.762761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1080/2130] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:58:31 2021] DELETE /identity/v3/projects/14a053fcef3c4657bf6098a6cc2f88d6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:31.768667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.769008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.769294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.787039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:31.788579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:31.862270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1051/2131] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:31.870623 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.871480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.871875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.892091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:31.893320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:31.902065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1081/2132] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:31.906864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:31.920795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3abad-8343-43c0-85c9-b7e87eef875e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:31.927702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:31.928384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.928670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.928949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.929706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:58:31.930007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:31.931640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:31.951759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1052/2133] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:58:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:58:31.952891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:31.966201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2600b-f123-461c-9351-d1e95e205028 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:31.971012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:31.971703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:31.971994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:31.972275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:31.972992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:31.974892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:32.010014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:32.010739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1082/2134] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:58:31 2021] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:58:32.024710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208139c9-1b33-4c8c-829c-852e1705083b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:32.119096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:32.120096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:32.120559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:32.120900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:32.122301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:32.124617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:32.154662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1053/2135] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:58:32 2021] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:58:32.157396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:32.169238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c041c2-2f01-4bcb-9486-b3eb6dbe689c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:32.174369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:32.175241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:32.175710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:32.176200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:32.177054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:32.178917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:32.197564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1083/2136] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:58:32.198519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:32.220453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066db36f-1bc4-48cc-9cb0-7ffb505a5ac5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:32.226259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c31fbf-d993-493d-a65b-d2daf6aa4c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:32.227001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c31fbf-d993-493d-a65b-d2daf6aa4c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:32.227295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c31fbf-d993-493d-a65b-d2daf6aa4c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:32.227766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c31fbf-d993-493d-a65b-d2daf6aa4c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:32.228466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c31fbf-d993-493d-a65b-d2daf6aa4c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:32.230864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c31fbf-d993-493d-a65b-d2daf6aa4c72 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:32.244779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1054/2137] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:58:32 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:58:32.247656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:32.257805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b5469-cecb-49cf-bf53-64c2db78af47 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:32.263510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:32.264428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:32.264710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:32.264981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] PATH_INFO: `/v3/projects/79869bd25d3c47ca87597d1801b9d710/users/e4b8ce2b334d42c8bf0196e992180e0f/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:32.279565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] RBAC: Authorizing `identity:create_grant(project_id=79869bd25d3c47ca87597d1801b9d710, user_id=e4b8ce2b334d42c8bf0196e992180e0f, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:32.282466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:32.298614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1084/2138] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:58:32 2021] PUT /identity/v3/projects/79869bd25d3c47ca87597d1801b9d710/users/e4b8ce2b334d42c8bf0196e992180e0f/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:32.304060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c147df-efd2-41e9-a751-27d781f04ee8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:32.304484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c147df-efd2-41e9-a751-27d781f04ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:32.304885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c147df-efd2-41e9-a751-27d781f04ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:32.323700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-21c147df-efd2-41e9-a751-27d781f04ee8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:32.324986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-21c147df-efd2-41e9-a751-27d781f04ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:32.390471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1055/2139] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:32.400384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:32.402054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:32.455558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56da33-37fa-49b6-bde7-96cb81676ced admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:32.459130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:32.459802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:32.460090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:32.460372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:32.469450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:32.470850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:32.480220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1085/2140] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:33.133542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6a77-d1f0-4488-a8c2-21a5e3da5f62 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:33.134660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6a77-d1f0-4488-a8c2-21a5e3da5f62 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:33.135112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6a77-d1f0-4488-a8c2-21a5e3da5f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:33.169530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b42a6a77-d1f0-4488-a8c2-21a5e3da5f62 None None] MFA Rules not processed for user `e4b8ce2b334d42c8bf0196e992180e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:33.170830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b42a6a77-d1f0-4488-a8c2-21a5e3da5f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:33.239687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1056/2141] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:33 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:33.250715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:33.252168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:33.319652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbd856-a35f-4c3f-a945-e7fb77faf1a0 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:33.324374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765dfc-ed77-4e6d-8558-0e486ac5a804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:33.325141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765dfc-ed77-4e6d-8558-0e486ac5a804 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:33.325427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765dfc-ed77-4e6d-8558-0e486ac5a804 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:33.326045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765dfc-ed77-4e6d-8558-0e486ac5a804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:33.336511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765dfc-ed77-4e6d-8558-0e486ac5a804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:33.338012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765dfc-ed77-4e6d-8558-0e486ac5a804 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:33.385198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1086/2142] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:33 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:43.082257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848a6d-f92d-4521-9312-453d012d851c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:43.082878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848a6d-f92d-4521-9312-453d012d851c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:43.082878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90848a6d-f92d-4521-9312-453d012d851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:43.102137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-90848a6d-f92d-4521-9312-453d012d851c None None] MFA Rules not processed for user `e4b8ce2b334d42c8bf0196e992180e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:43.103824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-90848a6d-f92d-4521-9312-453d012d851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:43.111056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1057/2143] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:43 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:58:43.743130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90b87-e3a3-42ac-99cb-f7218cbe9b38 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:43.743677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90b87-e3a3-42ac-99cb-f7218cbe9b38 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:43.743767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f90b87-e3a3-42ac-99cb-f7218cbe9b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:43.760285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f9f90b87-e3a3-42ac-99cb-f7218cbe9b38 None None] MFA Rules not processed for user `2dc41f90272e4a549aad1634f08342a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:43.761523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f9f90b87-e3a3-42ac-99cb-f7218cbe9b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:43.817288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1087/2144] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:43 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:43.914032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848a6d-f92d-4521-9312-453d012d851c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:43.915836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-90848a6d-f92d-4521-9312-453d012d851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:43.941675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90848a6d-f92d-4521-9312-453d012d851c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:43.947705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:43.948810 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:43.949333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:43.949712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] PATH_INFO: `/v3/users/28ae260b9ca94088a315d102295b7cd8` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:43.951204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ae260b9ca94088a315d102295b7cd8)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:43.954345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:44.031340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ae260b9ca94088a315d102295b7cd8'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:44.051555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ae260b9ca94088a315d102295b7cd8'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:44.052374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ae260b9ca94088a315d102295b7cd8'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:44.081880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ae260b9ca94088a315d102295b7cd8'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:44.095535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ae260b9ca94088a315d102295b7cd8'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:44.103334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1058/2145] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:58:43 2021] DELETE /identity/v3/users/28ae260b9ca94088a315d102295b7cd8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:44.108589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:44.108836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:44.115749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:44.138358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:44.139899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:44.224520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1088/2146] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:44.279891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:44.282038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:44.366904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd76ed2-14b6-4b0f-b8f1-719e62bbb8b4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:44.376094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:44.376997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:44.377275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:44.377803 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:44.390306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:44.392198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:44.408459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1059/2147] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:45.142054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:45.143964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:45.161195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d9e64-bf8c-443d-b62d-1b2c09365748 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:45.170655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:45.171538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:45.172087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:45.172597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] PATH_INFO: `/v3/projects/b14a97c82cce44babe2f1984d660e1ba` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:45.174017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14a97c82cce44babe2f1984d660e1ba)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:45.176938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:45.236401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14a97c82cce44babe2f1984d660e1ba', 'request_id': 'req-3a658b85-668c-4e01-90bc-8bf62fab3174'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:45.244234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14a97c82cce44babe2f1984d660e1ba', 'request_id': 'req-3a658b85-668c-4e01-90bc-8bf62fab3174'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:45.250834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14a97c82cce44babe2f1984d660e1ba', 'request_id': 'req-3a658b85-668c-4e01-90bc-8bf62fab3174'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:45.261754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] The token cache is being invalidate because project b14a97c82cce44babe2f1984d660e1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:58:45.262150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:45.262994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3a658b85-668c-4e01-90bc-8bf62fab3174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:45.265072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1089/2148] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:58:45 2021] DELETE /identity/v3/projects/b14a97c82cce44babe2f1984d660e1ba => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:47.434879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:47.436893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:47.473112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5962-605f-478e-a9ae-e75ce959c563 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:47.570474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:47.573409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:47.573708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:47.574671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] PATH_INFO: `/v3/users/ea9f0336a1bf4f6e8e1447a80fb166fe` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:47.576648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9f0336a1bf4f6e8e1447a80fb166fe)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:47.578602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:47.651135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9f0336a1bf4f6e8e1447a80fb166fe'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:47.663308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9f0336a1bf4f6e8e1447a80fb166fe'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:47.663976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9f0336a1bf4f6e8e1447a80fb166fe'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:47.689993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9f0336a1bf4f6e8e1447a80fb166fe'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:47.700201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9f0336a1bf4f6e8e1447a80fb166fe'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:47.707668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1060/2149] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:58:47 2021] DELETE /identity/v3/users/ea9f0336a1bf4f6e8e1447a80fb166fe => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:58:47.711478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:47.712000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:47.712089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:47.732639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:47.734467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:47.815029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1090/2150] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:47.833070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:47.834525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:47.895767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f42373-1a59-43c4-ba98-9917102c9789 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:47.901324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107d764-cdf1-4def-9b9e-fd3d3dba7119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:47.902554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d764-cdf1-4def-9b9e-fd3d3dba7119 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:47.902848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d764-cdf1-4def-9b9e-fd3d3dba7119 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:47.903147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107d764-cdf1-4def-9b9e-fd3d3dba7119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:47.915932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107d764-cdf1-4def-9b9e-fd3d3dba7119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:47.917408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107d764-cdf1-4def-9b9e-fd3d3dba7119 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:47.928466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1061/2151] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:48.641013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:48.645171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:48.664959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa530c39-7d5c-4205-a46e-f5d6b275d8ef None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:48.671226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:48.689198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:48.690446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:48.691747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] PATH_INFO: `/v3/projects/58cbb64ed13544249937344781d743cd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:48.696934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cbb64ed13544249937344781d743cd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:48.705216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:48.873208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cbb64ed13544249937344781d743cd', 'request_id': 'req-98cebef3-caf0-49d8-a242-7f4aef013991'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:48.888655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cbb64ed13544249937344781d743cd', 'request_id': 'req-98cebef3-caf0-49d8-a242-7f4aef013991'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:48.901526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cbb64ed13544249937344781d743cd', 'request_id': 'req-98cebef3-caf0-49d8-a242-7f4aef013991'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:48.915312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] The token cache is being invalidate because project 58cbb64ed13544249937344781d743cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:58:48.916213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:48.917374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-98cebef3-caf0-49d8-a242-7f4aef013991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:58:48.920119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1091/2152] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:58:48 2021] DELETE /identity/v3/projects/58cbb64ed13544249937344781d743cd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:58:48.926221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:48.927225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:48.927784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:48.949328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:48.950818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:49.032953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1062/2153] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:49.041573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.041573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.041821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.076712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:49.078185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:49.108749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1092/2154] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:58:49.109746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.120482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6a62b-b0b6-4886-bb7d-eb8ed8ccb64d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.125791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.127232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.127869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.128317 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.129281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:58:49.129753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.131609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.151345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1063/2155] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:58:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:58:49.156658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.167791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0ac61-39d5-4360-ade9-a3d2e1194407 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.174203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.174946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.175305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.175730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.176548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.178807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.225140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1093/2156] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:58:49 2021] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:58:49.230368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.246403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d38276-3387-44a3-99cd-891739804000 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.333230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.334193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.334661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.335155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.336103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.338219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.366335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1064/2157] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:58:49 2021] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:58:49.370938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.383055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2debbb74-c8e0-4b9b-bfd9-41db78f25493 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.401080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.402435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.402787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.403201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.404221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.406219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.420878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1094/2158] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:58:49.424498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.436437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8308-ae27-4e0a-bc4a-9374e55f5e70 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.452020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fa8b3-dc35-4af1-a727-11ce9e2ce092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.453188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fa8b3-dc35-4af1-a727-11ce9e2ce092 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.453679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fa8b3-dc35-4af1-a727-11ce9e2ce092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.454331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fa8b3-dc35-4af1-a727-11ce9e2ce092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.455580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fa8b3-dc35-4af1-a727-11ce9e2ce092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.457593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fa8b3-dc35-4af1-a727-11ce9e2ce092 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.468723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1065/2159] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:58:49 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 04:58:49.473356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.488104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b75ba-c641-4ed6-89f6-3a8ad4428854 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.492811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.493695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.493996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.494264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] PATH_INFO: `/v3/projects/777d920b381b4d6ebddb042851d48a3a/users/8e40320037334f188c1696df06da0bfc/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.517222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=777d920b381b4d6ebddb042851d48a3a, user_id=8e40320037334f188c1696df06da0bfc, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.520389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.539833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1095/2160] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:58:49 2021] PUT /identity/v3/projects/777d920b381b4d6ebddb042851d48a3a/users/8e40320037334f188c1696df06da0bfc/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:58:49.552493 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272da0-ca7d-4c8b-b10c-b15f4a02e558 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.552854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272da0-ca7d-4c8b-b10c-b15f4a02e558 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.553230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a272da0-ca7d-4c8b-b10c-b15f4a02e558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.616134 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8a272da0-ca7d-4c8b-b10c-b15f4a02e558 None None] MFA Rules not processed for user `8e40320037334f188c1696df06da0bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:49.617359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8a272da0-ca7d-4c8b-b10c-b15f4a02e558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:49.716191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1066/2161] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:49 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:49.728725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:49.731656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:49.801899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d8f5b-714f-46a0-9769-7450fc16d2f4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:49.805701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:49.806348 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:49.806634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:49.806911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:49.815735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:49.817183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:49.826086 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1096/2162] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:58:49 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:58:56.414705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c32a-ee0a-4648-b16f-aaa72ca0272f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:56.415162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c32a-ee0a-4648-b16f-aaa72ca0272f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:56.415284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3c32a-ee0a-4648-b16f-aaa72ca0272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:56.439908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7ff3c32a-ee0a-4648-b16f-aaa72ca0272f None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:56.441084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7ff3c32a-ee0a-4648-b16f-aaa72ca0272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:56.513825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1067/2163] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:58:56 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:58:56.559456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:58:56.561408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:56.627259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f8a2f-75c3-495f-9e9b-fef6d6b163f4 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:58:56.632259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d35505-9e05-4ee3-a7e3-d073918762cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:58:56.632903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d35505-9e05-4ee3-a7e3-d073918762cc service swift] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:56.633192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d35505-9e05-4ee3-a7e3-d073918762cc service swift] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:56.633479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d35505-9e05-4ee3-a7e3-d073918762cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:56.641794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d35505-9e05-4ee3-a7e3-d073918762cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:58:56.643370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d35505-9e05-4ee3-a7e3-d073918762cc service swift] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:58:56.651051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1097/2164] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:58:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:58:57.473233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:58:57.473756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:58:57.473851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:58:57.498031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] MFA Rules not processed for user `8e40320037334f188c1696df06da0bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:58:57.500579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:58:57.515884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1068/2165] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:58:57 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:16.085528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7446960-e414-4379-896b-2d489e04eaec None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:16.086126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7446960-e414-4379-896b-2d489e04eaec None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:16.086126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7446960-e414-4379-896b-2d489e04eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:16.115370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c7446960-e414-4379-896b-2d489e04eaec None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:16.116769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c7446960-e414-4379-896b-2d489e04eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:16.144573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1098/2166] 10.222.0.41 () {58 vars in 967 bytes} [Tue Nov 9 04:59:16 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:16.158995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:16.193795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc6fc6-bd64-45e9-8428-602fb09a99e8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:16.199939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:16.200607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:16.200890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:16.201167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:16.209835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:16.211425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:16.219216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1069/2167] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:59:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:59:18.212183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7446960-e414-4379-896b-2d489e04eaec None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:18.213748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c7446960-e414-4379-896b-2d489e04eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:18.318292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7446960-e414-4379-896b-2d489e04eaec None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:18.323421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:18.324320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:18.324606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:18.324884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] PATH_INFO: `/v3/users/0952832b106844dea05a888f4266dd95` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:18.326202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0952832b106844dea05a888f4266dd95)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:18.328055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:18.372166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0952832b106844dea05a888f4266dd95'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.383575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0952832b106844dea05a888f4266dd95'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.384691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0952832b106844dea05a888f4266dd95'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.385912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0952832b106844dea05a888f4266dd95'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.393883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-51f76a72-09da-4c51-b1d9-cb502858ab2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0952832b106844dea05a888f4266dd95'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.406443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1099/2168] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:59:18 2021] DELETE /identity/v3/users/0952832b106844dea05a888f4266dd95 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:59:18.615657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:18.627084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987aeb46-6422-461a-a2c2-1800e1147a3e service swift] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:18.689795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:18.690652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:18.690933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:18.691207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] PATH_INFO: `/v3/projects/0bab423d141e49b29b86b769cfa8d939` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:18.692420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bab423d141e49b29b86b769cfa8d939)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:18.694362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:18.747881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bab423d141e49b29b86b769cfa8d939', 'request_id': 'req-de96cd66-bee0-4758-a389-2f60cc620e13'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.753815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bab423d141e49b29b86b769cfa8d939', 'request_id': 'req-de96cd66-bee0-4758-a389-2f60cc620e13'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.763266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bab423d141e49b29b86b769cfa8d939', 'request_id': 'req-de96cd66-bee0-4758-a389-2f60cc620e13'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.775594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] The token cache is being invalidate because project 0bab423d141e49b29b86b769cfa8d939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:59:18.776439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.777113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-de96cd66-bee0-4758-a389-2f60cc620e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:18.778635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1070/2169] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:59:18 2021] DELETE /identity/v3/projects/0bab423d141e49b29b86b769cfa8d939 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:59:18.784669 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:18.784967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:18.785251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:18.829639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:18.830848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:18.893976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1100/2170] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:59:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:18.904691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:18.905290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:18.905530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:18.925070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:18.926262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:18.935557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1071/2171] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:59:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:18.939540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:18.949286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b477b3-d942-43d8-95ce-f725e1f43e10 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:18.953758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:18.954416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:18.954703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:18.954980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:18.955757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 04:59:18.956062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:18.957630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:18.969328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1101/2172] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 04:59:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 04:59:18.973534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:18.983058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1383841-c85e-48cb-a88b-9a4812e58db8 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:18.987722 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:18.988369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:18.988650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:18.988925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:18.989772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:18.991708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:19.018182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1072/2173] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 04:59:18 2021] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 04:59:19.022180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:19.033205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44bbc6a-8943-4b3d-b89e-1c62aea55f61 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:19.089714 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:19.090383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:19.090667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:19.090943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:19.091874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:19.093779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:19.112686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1102/2174] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 04:59:19 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 04:59:19.116509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:19.127477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9227cf-b943-4fcd-ad90-3cf6ee26f377 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:19.136194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:19.136194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:19.136194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:19.136194 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:19.136733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:19.136733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:19.147509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1073/2175] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:59:19.151503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:19.161729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ea238-31a5-4506-b859-6cf937364f4a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:19.166821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32f121-3c36-4591-bc77-ee85aff64d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:19.167476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f121-3c36-4591-bc77-ee85aff64d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:19.167797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f121-3c36-4591-bc77-ee85aff64d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:19.168074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32f121-3c36-4591-bc77-ee85aff64d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:19.168812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f121-3c36-4591-bc77-ee85aff64d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:19.170490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32f121-3c36-4591-bc77-ee85aff64d11 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:19.180130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1103/2176] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 04:59:19 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 04:59:19.184547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:19.194176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8e9a1-f6af-4b9b-ab23-6a354e8e1e69 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:19.198735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:19.199593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:19.199907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:19.200186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] PATH_INFO: `/v3/projects/79181769ac264cab9e41b5a492c2679b/users/c32def54245d4ae0844d445d362bc100/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:19.214261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79181769ac264cab9e41b5a492c2679b, user_id=c32def54245d4ae0844d445d362bc100, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:19.216930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:19.230237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1074/2177] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 04:59:19 2021] PUT /identity/v3/projects/79181769ac264cab9e41b5a492c2679b/users/c32def54245d4ae0844d445d362bc100/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:59:19.240698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583da0e-7bc6-4670-9ce2-0c0ca0cf4970 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:19.241199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583da0e-7bc6-4670-9ce2-0c0ca0cf4970 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:19.241299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583da0e-7bc6-4670-9ce2-0c0ca0cf4970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:19.268167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b583da0e-7bc6-4670-9ce2-0c0ca0cf4970 None None] MFA Rules not processed for user `c32def54245d4ae0844d445d362bc100`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:19.269470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b583da0e-7bc6-4670-9ce2-0c0ca0cf4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:19.332762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1104/2178] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:59:19 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:19.343364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:19.345204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:19.408160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbefbe-7867-49a0-a484-499f44136641 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:19.412440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef59a6-98c9-4e69-bc8f-daed305eebbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:19.413395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef59a6-98c9-4e69-bc8f-daed305eebbe service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:19.413679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef59a6-98c9-4e69-bc8f-daed305eebbe service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:19.413954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef59a6-98c9-4e69-bc8f-daed305eebbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:19.423935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef59a6-98c9-4e69-bc8f-daed305eebbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:19.425582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef59a6-98c9-4e69-bc8f-daed305eebbe service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:19.437348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1075/2179] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:59:19 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:59:22.230019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:22.230567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:22.230567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:22.248027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] MFA Rules not processed for user `2dc41f90272e4a549aad1634f08342a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:22.249199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:22.305319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1105/2180] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:59:22 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:22.967537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:22.968179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:22.968179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:22.995178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:22.996522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:23.055565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1076/2181] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:59:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:23.069113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:23.070227 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:23.073607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:23.147390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e6dc0-a287-4944-8199-7d1d03ebb483 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:23.158862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ffaf3-2ce4-445b-9af2-3102442ac701 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:23.159397 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ffaf3-2ce4-445b-9af2-3102442ac701 service swift] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:23.159717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ffaf3-2ce4-445b-9af2-3102442ac701 service swift] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:23.160005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ffaf3-2ce4-445b-9af2-3102442ac701 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:23.168296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ab2d0-2e2c-46f5-9b70-0ee0cff24b43 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:23.170889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ffaf3-2ce4-445b-9af2-3102442ac701 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:23.172528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ffaf3-2ce4-445b-9af2-3102442ac701 service swift] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:23.173849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:23.174825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:23.175440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:23.175613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] PATH_INFO: `/v3/users/c32def54245d4ae0844d445d362bc100` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:23.180636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32def54245d4ae0844d445d362bc100)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:23.182853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:23.188191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1106/2182] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:59:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:59:23.266879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32def54245d4ae0844d445d362bc100'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.280636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32def54245d4ae0844d445d362bc100'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.284591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32def54245d4ae0844d445d362bc100'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.303321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32def54245d4ae0844d445d362bc100'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.310836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32def54245d4ae0844d445d362bc100'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.316829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1077/2183] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:59:23 2021] DELETE /identity/v3/users/c32def54245d4ae0844d445d362bc100 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 04:59:23.321489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:23.321916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:23.321916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:23.341485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:23.342985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:23.417758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1107/2184] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:59:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:23.427652 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:23.429433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:23.525419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d98c4-8399-4af7-a97a-233e060a4cfa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:23.529149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e0138-93c2-4583-9eb6-026e65b7d879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:23.530061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0138-93c2-4583-9eb6-026e65b7d879 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:23.530349 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0138-93c2-4583-9eb6-026e65b7d879 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:23.530626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e0138-93c2-4583-9eb6-026e65b7d879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:23.540258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e0138-93c2-4583-9eb6-026e65b7d879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:23.542072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e0138-93c2-4583-9eb6-026e65b7d879 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:23.561279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1078/2185] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:59:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:59:23.874330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:23.875925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:23.889067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00f654-e532-4d2c-bf24-4472a439b245 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:23.894661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:23.896368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:23.896782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:23.897160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] PATH_INFO: `/v3/projects/79181769ac264cab9e41b5a492c2679b` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:23.898494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79181769ac264cab9e41b5a492c2679b)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:23.901170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:23.921812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118b43-42a8-49e6-b045-2c6d682d83bb None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:23.922295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118b43-42a8-49e6-b045-2c6d682d83bb None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:23.922668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118b43-42a8-49e6-b045-2c6d682d83bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:23.946842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f4118b43-42a8-49e6-b045-2c6d682d83bb None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:23.948576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f4118b43-42a8-49e6-b045-2c6d682d83bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:23.967284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79181769ac264cab9e41b5a492c2679b', 'request_id': 'req-37e72117-da0b-4985-8a6d-95aca4db30e1'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.976903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79181769ac264cab9e41b5a492c2679b', 'request_id': 'req-37e72117-da0b-4985-8a6d-95aca4db30e1'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.983649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79181769ac264cab9e41b5a492c2679b', 'request_id': 'req-37e72117-da0b-4985-8a6d-95aca4db30e1'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.997055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] The token cache is being invalidate because project 79181769ac264cab9e41b5a492c2679b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:59:23.997357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.998019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:23.999896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1108/2186] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:59:23 2021] DELETE /identity/v3/projects/79181769ac264cab9e41b5a492c2679b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:59:24.016085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1079/2187] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 04:59:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 04:59:24.044879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:24.046767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:24.128847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e72117-da0b-4985-8a6d-95aca4db30e1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:24.134216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:24.135602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:24.135790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:24.136061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:24.148064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:24.150139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:24.162314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1109/2188] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:59:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:59:24.541953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:24.542328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:24.542671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:24.569002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:24.570287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:24.577397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1080/2189] 10.222.0.41 () {58 vars in 967 bytes} [Tue Nov 9 04:59:24 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:24.590470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:24.600780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cddf19-8658-4a5f-bf61-13aefab879dc service swift] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:24.606399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19a761-972d-4be9-9a14-edd5b865de79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:24.607163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a761-972d-4be9-9a14-edd5b865de79 service swift] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:24.607515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a761-972d-4be9-9a14-edd5b865de79 service swift] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:24.607883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19a761-972d-4be9-9a14-edd5b865de79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:24.617813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a761-972d-4be9-9a14-edd5b865de79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:24.620879 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19a761-972d-4be9-9a14-edd5b865de79 service swift] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:24.629943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1110/2190] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 04:59:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 04:59:26.729065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:26.730543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:26.802130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ec937-61ab-4110-b256-ab52e655d37e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:26.806654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:26.808175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:26.808457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:26.808732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] PATH_INFO: `/v3/users/8e40320037334f188c1696df06da0bfc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:26.810153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e40320037334f188c1696df06da0bfc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:26.812121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:26.861860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e40320037334f188c1696df06da0bfc'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:26.870631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e40320037334f188c1696df06da0bfc'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:26.871979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e40320037334f188c1696df06da0bfc'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:26.887538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e40320037334f188c1696df06da0bfc'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:26.894969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e40320037334f188c1696df06da0bfc'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:26.901045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1081/2191] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 04:59:26 2021] DELETE /identity/v3/users/8e40320037334f188c1696df06da0bfc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 04:59:26.905920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:26.906430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:26.906711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:26.932526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 04:59:26.933924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:26.989601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1111/2192] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 04:59:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 04:59:27.000541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:27.015756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:27.080589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997594de-edbc-4939-99fd-59ab9badff80 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:27.084275 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:27.084919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:27.085233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:27.085512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:27.094945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:27.096406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:27.106119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1082/2193] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 04:59:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 04:59:27.276463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 04:59:27.277926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 04:59:27.289802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cd76c-f31b-46be-9f25-d8f0d9fe234d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 04:59:27.294959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 04:59:27.295978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 04:59:27.296366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 04:59:27.296645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] PATH_INFO: `/v3/projects/777d920b381b4d6ebddb042851d48a3a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 04:59:27.298029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777d920b381b4d6ebddb042851d48a3a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 04:59:27.300097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 04:59:27.350492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777d920b381b4d6ebddb042851d48a3a', 'request_id': 'req-74da5114-c7df-47ac-b645-b933b6e1aaf3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:27.360387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777d920b381b4d6ebddb042851d48a3a', 'request_id': 'req-74da5114-c7df-47ac-b645-b933b6e1aaf3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:27.369738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777d920b381b4d6ebddb042851d48a3a', 'request_id': 'req-74da5114-c7df-47ac-b645-b933b6e1aaf3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:27.380869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] The token cache is being invalidate because project 777d920b381b4d6ebddb042851d48a3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 04:59:27.381291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:27.381938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 04:59:27.383457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1112/2194] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 04:59:27 2021] DELETE /identity/v3/projects/777d920b381b4d6ebddb042851d48a3a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:00:35.296855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:00:35.298224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:00:35.382464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd164650-0526-4a8d-a5a2-7d29b91afc00 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:00:35.445172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:00:35.445822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:00:35.446104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:00:35.446381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:00:35.448776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:00:35.459689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:00:35.461249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:00:35.470612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1083/2195] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:00:35 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:01:27.538836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:01:27.540300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:01:27.615765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da5114-c7df-47ac-b645-b933b6e1aaf3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:01:27.619405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:01:27.620078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:01:27.620870 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:01:27.621144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:01:27.622935 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:01:27.677413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:01:27.678827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:01:27.687916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1113/2196] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:01:27 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:01:39.273091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:01:39.282838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb897ab-efca-481c-9450-a7a9b2dbc91c service placement] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:01:39.286418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:01:39.287049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:01:39.287327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:01:39.287764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:01:39.289481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:01:39.299178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:01:39.300683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:01:39.354267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:01:39.356289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:01:39.365747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1084/2197] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:01:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:01:39.407766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e306f75-74a6-441a-b535-61df4848bae5 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:01:39.414312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:01:39.414964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:01:39.415253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:01:39.415683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:01:39.417587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:01:39.473667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:01:39.475265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:01:39.484072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1114/2198] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:01:39 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:02:40.754698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:02:40.756181 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:02:40.809794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585b318-25d1-4615-8517-0b38af67ab3e service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:02:40.813383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:02:40.814020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:02:40.814305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:02:40.814584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:02:40.816364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:02:40.825341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:02:40.826758 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:02:40.834465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1085/2199] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:02:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:03:03.917496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:03:03.919006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:03:03.930286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d44e6b-60f4-40a8-8b2b-8d6457f16cd9 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:03:03.933784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:03:03.934437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:03:03.934722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:03:03.934995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:03:03.936702 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:03:03.993314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:03:03.994831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bac1-156a-4daa-9846-08c4d54d9125 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:03:04.003790 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1115/2200] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:03:03 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:03:32.268408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:03:32.277721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88052c0-b152-4755-ae0c-a8b88f6d3ece service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:03:32.281796 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:03:32.282426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:03:32.282708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:03:32.282988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:03:32.284776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:03:32.340492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:03:32.341846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f335a3-5deb-40c3-828d-b0d43e3ef6d6 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:03:32.351083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1086/2201] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:03:32 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:05:42.227404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ff78-1d25-4a03-ad9f-40111f4d826a None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:05:42.227869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ff78-1d25-4a03-ad9f-40111f4d826a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:05:42.228014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2ff78-1d25-4a03-ad9f-40111f4d826a None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:05:42.229804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1116/2202] 10.222.0.41 () {54 vars in 960 bytes} [Tue Nov 9 05:05:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 05:05:42.235145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:05:42.235581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:05:42.235716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:05:42.280562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] MFA Rules not processed for user `e2a6d780d4ee491b933e0eac87c13593`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:05:42.282422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:05:42.293970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1087/2203] 10.222.0.41 () {58 vars in 1057 bytes} [Tue Nov 9 05:05:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:05:42.303956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2ff78-1d25-4a03-ad9f-40111f4d826a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:05:42.317734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2ff78-1d25-4a03-ad9f-40111f4d826a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:05:42.322546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:05:42.323319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:05:42.323739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:05:42.324020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:05:42.332758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:05:42.334460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:05:42.343980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1117/2204] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:05:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:03.120441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:03.129342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067c721-cdd3-484a-8317-24ac3e7c2527 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:03.132954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:03.133613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:03.133896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:03.134174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:03.135920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:03.149404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:03.150751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:03.161895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1088/2205] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:05.315297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:05.324257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f9aa7-5b72-4353-9cbf-8bc7916340c5 service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:05.328093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:05.328740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:05.329076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:05.329360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:05.331116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:05.344431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:05.345850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:05.356344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1118/2206] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:06:05.622086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:05.624395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:05.641844 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b815ffe-9c5e-403c-8c6b-af06966684cf service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:05.648915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:05.649608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:05.649893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:05.650170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:05.652248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:05.665633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:05.667221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d84ed-dad1-4ee7-a182-69fa541a6534 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:05.679756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1089/2207] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:27.510160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:27.519747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273c6db-2a61-448e-99ce-9fd192b2fb96 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:27.523363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:27.524042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:27.524369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:27.524652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:27.535728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:27.537216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:27.572693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1119/2208] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:27 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:32.945734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:32.946294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:32.946294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:32.986766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] MFA Rules not processed for user `115a975a272c4ad9a5e93a38ee1c8180`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:06:32.988004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:32.994889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1090/2209] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:06:32 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:06:33.294748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:33.296228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:33.308130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690d65d-c2e7-47c6-b116-30e1b582e835 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:33.311582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:33.312239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:33.312523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:33.312805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:33.314455 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:33.323206 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:33.324645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:33.332297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1120/2210] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:33 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:33.646519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:33.647895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:33.663075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c85df-cfd3-43d0-ae46-a5fb9b2d889c None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:33.668029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:33.668675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:33.668961 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:33.669239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:33.670992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:33.682495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:33.684100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:33.694413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1091/2211] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:33 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:39.580447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:39.588780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cfcaf-ecbf-4ce4-aa90-f15b8a30c892 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:39.592417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:39.593053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:39.593338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:39.593617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:39.602563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:39.604023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:39.623244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1121/2212] 10.222.0.41 () {60 vars in 1396 bytes} [Tue Nov 9 05:06:39 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:39.715021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:39.724709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96be67-a816-403d-b0bc-2ce3199421b2 service placement] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:39.728400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:39.729036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:39.729318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:39.729592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:39.738448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:39.739906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:39.765865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1092/2213] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:39 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:06:42.137179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:06:42.151681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a4b51-f6d9-46a9-b5a7-448abe69bcb9 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:06:42.158880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:06:42.159665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:06:42.160161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:06:42.160536 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:06:42.162693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:06:42.175666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:06:42.177475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644ff64-c29f-4595-9f3a-33c6761f9b42 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:06:42.201717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1122/2214] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:06:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:07:21.626734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:07:21.640916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7c50a-5353-40e4-a9d8-49063d490ef8 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:07:21.648969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:07:21.649771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:07:21.650402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:07:21.650772 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:07:21.652950 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:07:21.667381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:07:21.668998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:07:21.680040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1093/2215] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:07:21 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:07:24.993972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:07:24.994515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:07:24.994668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:07:25.011763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] MFA Rules not processed for user `07d92b2e7b1b46f6916c335b25a44ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:07:25.012953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:07:25.019991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1123/2216] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:07:24 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:07:46.870473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:07:46.879677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d137d-9773-46de-9f71-600642dc62a2 service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:07:46.883862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:07:46.884495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:07:46.884779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:07:46.885058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:07:46.892496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:07:46.894170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:07:46.902691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1094/2217] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:07:46 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:08:04.384809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:08:04.397891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5eceb-b8dd-4241-8627-e7f5914dc3ee None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:08:04.403287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:08:04.403894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:08:04.404182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:08:04.404462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:08:04.412012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:08:04.414269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:08:04.422857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1124/2218] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:08:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:08:32.535061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:08:32.544255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a651cce-4ab3-4364-9eec-be28b118e5a6 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:08:32.547764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:08:32.548385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:08:32.548665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:08:32.548938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:08:32.557140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:08:32.558550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:08:32.567681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1095/2219] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:08:32 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:10:46.227349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:10:46.334511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed20ff-9a76-4dcb-ada9-70b406557816 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:10:46.340064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:10:46.340705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:10:46.340993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:10:46.341273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:10:46.343129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:10:46.374943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:10:46.376575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:10:46.386492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1125/2220] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:10:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:11:26.934560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:11:26.952747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393e5a-1893-4446-b24b-cd3a6df43c19 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:11:26.956366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:11:26.956995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:11:26.957276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:11:26.957552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:11:26.965691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:11:26.967101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:11:26.975563 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1096/2221] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:11:26 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:11:38.841966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:11:38.901880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16af0d9-d1e2-433e-8c62-05822702c9bd service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:11:38.905485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:11:38.906120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:11:38.906407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:11:38.906687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:11:38.915680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:11:38.917092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:11:38.925771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1126/2222] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:11:38 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:11:39.560695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:11:39.621769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a8f90-dfb2-46cc-9f14-82cf4bf010ad service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:11:39.625429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:11:39.626072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:11:39.626356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:11:39.626640 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:11:39.628545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:11:39.690931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:11:39.692415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:11:39.701916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1097/2223] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:11:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:12:03.859592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:12:03.878125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdd430-9365-41cb-ab54-94a5afab42af service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:12:03.881709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:12:03.882335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:12:03.882622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:12:03.882897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:12:03.951725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:12:03.953144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:12:03.972023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1127/2224] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:12:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:12:05.159709 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:12:05.168621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63012f-fd50-4473-a168-b13efdb6524a service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:12:05.172253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:12:05.172869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:12:05.173155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:12:05.173435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:12:05.183374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:12:05.184823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:12:05.195499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1098/2225] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:12:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:12:54.882343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:12:54.933460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec63e-84fa-4f44-8af6-9466cd39016b service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:12:54.937067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:12:54.937708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:12:54.938014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:12:54.938296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:12:54.940169 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:12:54.960576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:12:54.961998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:12:54.970181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1128/2226] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:12:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:13:04.529238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:13:04.530797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:13:04.554062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bb371-cbb9-402e-a831-dbbc5dbc131f service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:13:04.558388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:13:04.559026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:13:04.559308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:13:04.559579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:13:04.561477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:13:04.639243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:13:04.640698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:13:04.657894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1099/2227] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:13:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:13:32.789940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:13:32.802700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7f3d-15ce-4761-bfe0-d061b3af438e service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:13:32.808581 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:13:32.809239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:13:32.809522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:13:32.809800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:13:32.811647 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:13:32.887319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:13:32.888918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:13:32.910594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1129/2228] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:13:32 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:14:07.009110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:14:07.010924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:14:07.046308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74832232-17af-452e-adf8-458609bda3fe service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:14:07.052183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:14:07.052834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:14:07.053222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:14:07.053376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:14:07.065405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:14:07.067288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:14:07.078845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1100/2229] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:14:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:15:49.150567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:15:49.161414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9376d22c-fd6f-4391-a92e-8c00ad3bab3a service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:15:49.167035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:15:49.167767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:15:49.168057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:15:49.168336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:15:49.176465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:15:49.178021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:15:49.187286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1130/2230] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:15:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:16:27.792033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:16:27.801115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69312db4-4d3d-484c-9340-2378e2107dea service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:16:27.804650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:16:27.805280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:16:27.805562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:16:27.805835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:16:27.807699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:16:27.886493 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:16:27.887995 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:16:27.906288 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1101/2231] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:16:27 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:16:39.293958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:16:39.302826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34204e1d-4928-46b1-b1eb-1659f5f24ae8 service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:16:39.306834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:16:39.307457 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:16:39.307774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:16:39.308054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:16:39.310015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:16:39.376032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:16:39.377464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:16:39.386796 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1131/2232] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:16:39 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:16:39.466468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:16:39.475198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c8df1c-93d1-4e94-a665-f7febe5412aa service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:16:39.479489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:16:39.480162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:16:39.480446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:16:39.480934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:16:39.489361 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:16:39.490782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:16:39.499589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1102/2233] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:16:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:17:05.128831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:17:05.130381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:17:05.142232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3e7d3-96f4-4a71-b712-595028b6cff3 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:17:05.145701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:17:05.146327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:17:05.146610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:17:05.146884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:17:05.148680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:17:05.161654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:17:05.163058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:17:05.173740 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1132/2234] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:17:05 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:17:06.339328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:17:06.341016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:17:06.352680 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c560c1-5a6f-463a-b7a4-0fd547113b43 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:17:06.356513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:17:06.357151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:17:06.357436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:17:06.357714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:17:06.359497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:17:06.372568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:17:06.373972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:17:06.384330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1103/2235] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:17:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:17:58.848609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:17:58.856809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36262-d2b0-42f0-bad1-fc98eae43d36 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:17:58.860422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:17:58.861080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:17:58.861391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:17:58.861671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:17:58.869121 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:17:58.870531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:17:58.878051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1133/2236] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:17:58 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:04.525636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:04.527223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:04.538072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a22d04-11a9-4a20-8c71-41aa3d53ea6a service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:04.541778 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:04.542418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:04.542704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:04.542987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:04.551809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:04.553239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:04.564826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1104/2237] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:14.250891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:14.259330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb065b-fb24-4b96-93b4-ac392347f70d service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:14.266007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:14.266007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:14.266007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:14.266007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:14.267637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:14.348282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:14.349698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:14.368495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1134/2238] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:15.087043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.088781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:15.103497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136b88-278c-4319-9221-e6f3ded0f31d service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.108921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.109780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.110060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.110329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] PATH_INFO: `/v3/users/2dc41f90272e4a549aad1634f08342a6` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.111535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc41f90272e4a549aad1634f08342a6)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.113463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.158835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc41f90272e4a549aad1634f08342a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.165697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc41f90272e4a549aad1634f08342a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.166355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc41f90272e4a549aad1634f08342a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.178536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc41f90272e4a549aad1634f08342a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.185149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0e605e8e-441f-41b9-861c-ed0b9a0f5f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc41f90272e4a549aad1634f08342a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.190880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1105/2239] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:18:15 2021] DELETE /identity/v3/users/2dc41f90272e4a549aad1634f08342a6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:15.367128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.377204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20bc54-d737-4d21-85d2-f3a22a40f1f9 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.432142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.432991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.433277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.433553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] PATH_INFO: `/v3/projects/3e9bea92048e49debbf053fea8eb2b9f` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.434764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e9bea92048e49debbf053fea8eb2b9f)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.436677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.482401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e9bea92048e49debbf053fea8eb2b9f', 'request_id': 'req-0ea43919-2560-46ab-951a-7e5da1ccd010'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.489976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e9bea92048e49debbf053fea8eb2b9f', 'request_id': 'req-0ea43919-2560-46ab-951a-7e5da1ccd010'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.496944 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e9bea92048e49debbf053fea8eb2b9f', 'request_id': 'req-0ea43919-2560-46ab-951a-7e5da1ccd010'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.509983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] The token cache is being invalidate because project 3e9bea92048e49debbf053fea8eb2b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:18:15.510267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.510919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0ea43919-2560-46ab-951a-7e5da1ccd010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:15.512983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1135/2240] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:18:15 2021] DELETE /identity/v3/projects/3e9bea92048e49debbf053fea8eb2b9f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:15.519787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.520078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.520358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.574054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:15.575851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:15.632687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1106/2241] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:18:15.641309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.641601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.641909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.660282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:15.661459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:15.670118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1136/2242] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:15.674143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.683412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaade42-db23-4dcb-8962-fcdbee1f0fac None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.688456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.689101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.689381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.689657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.690390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:18:15.690699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.692353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.703952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1107/2243] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:18:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:18:15.708141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.717463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0fc63-6a56-42c7-a3a4-6629f5cc0c4e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.722379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.723036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.723323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.723602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.724346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.726251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.760290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1137/2244] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:18:15 2021] POST /identity/v3/projects => generated 405 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:15.765350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.775416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9453f-ea7d-41cc-8d40-5a1a83b5e350 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.850114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.850728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.851029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.851309 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.852091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.853983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.873549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1108/2245] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:18:15 2021] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:15.877772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.888291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e18b49-e67b-4802-a873-bba7f9e899fa admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.893063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.893713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.893995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.894296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.895031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.896644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.906140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1138/2246] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:15.909916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.919604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db7724-5eb9-4f22-8061-e31319e216bd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.924350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba60ee-d094-4caf-8025-e052568241b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.924996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba60ee-d094-4caf-8025-e052568241b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.925285 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba60ee-d094-4caf-8025-e052568241b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.925565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba60ee-d094-4caf-8025-e052568241b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.926303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba60ee-d094-4caf-8025-e052568241b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.927924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba60ee-d094-4caf-8025-e052568241b1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.938012 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1109/2247] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:15.942072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:15.952222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a63541-e9f8-429e-a33c-28b674878709 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:15.956696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:15.957561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.957840 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.958113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] PATH_INFO: `/v3/projects/1a94cb091b134157a10708891b32940c/users/358823fb732e4fbdbbcb562d1407c56a/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:15.972211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a94cb091b134157a10708891b32940c, user_id=358823fb732e4fbdbbcb562d1407c56a, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:15.974832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:15.989144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1139/2248] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:15 2021] PUT /identity/v3/projects/1a94cb091b134157a10708891b32940c/users/358823fb732e4fbdbbcb562d1407c56a/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:15.994163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154baf4f-9d40-47ab-a5c0-d7097063adaa None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:15.994456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154baf4f-9d40-47ab-a5c0-d7097063adaa None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:15.994738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154baf4f-9d40-47ab-a5c0-d7097063adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:16.013342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-154baf4f-9d40-47ab-a5c0-d7097063adaa None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:16.014776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-154baf4f-9d40-47ab-a5c0-d7097063adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:16.069482 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1110/2249] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:18:16.080002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:16.081700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:16.146652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926dea4-4bf8-4a6e-b98e-449644af19db admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:16.153040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:16.153685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:16.153970 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:16.154249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:16.163954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:16.165415 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:16.180114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1140/2250] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:16.794658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:16.795193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:16.795193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:16.821252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] MFA Rules not processed for user `358823fb732e4fbdbbcb562d1407c56a`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:16.822480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:16.886274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1111/2251] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:16 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:18:16.891274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:16.900920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fd329-cf85-4ba6-ad9b-49934fab2783 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:16.906023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:16.906713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:16.907030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:16.907315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:16.908076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:16.909979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:16.935739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1141/2252] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:18:16 2021] POST /identity/v3/projects => generated 405 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:16.939808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:16.950499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fcb20-9d4a-4950-be86-5ed07be38be0 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:17.004791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:17.005594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:17.005942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:17.006227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:17.006959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:17.008890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:17.034400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1112/2253] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:18:16 2021] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:17.038209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:17.050027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5f3de-c085-4a7f-b677-490e356591da admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:17.054844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:17.055586 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:17.056073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:17.056422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:17.057317 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:17.059199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:17.070856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1142/2254] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:17 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:17.075505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:17.085416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf5af7-9750-470a-bab6-4bfd63cc3243 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:17.090818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:17.091759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:17.092072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:17.092349 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] PATH_INFO: `/v3/projects/31972ee08e4c44b0b86720ef9ba6e936/users/59793c7e8f55489295df7f8ed8f47e2e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:17.106718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31972ee08e4c44b0b86720ef9ba6e936, user_id=59793c7e8f55489295df7f8ed8f47e2e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:17.109857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:17.122680 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1113/2255] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:17 2021] PUT /identity/v3/projects/31972ee08e4c44b0b86720ef9ba6e936/users/59793c7e8f55489295df7f8ed8f47e2e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:17.126584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:17.136309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28c80-17e8-485b-8495-3c774fda05b0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:17.198270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfce932-6535-4aa6-b3de-78641ebc05e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:17.198945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce932-6535-4aa6-b3de-78641ebc05e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:17.199233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce932-6535-4aa6-b3de-78641ebc05e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:17.200179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfce932-6535-4aa6-b3de-78641ebc05e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:17.200931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfce932-6535-4aa6-b3de-78641ebc05e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:17.202498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfce932-6535-4aa6-b3de-78641ebc05e5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:17.212166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1143/2256] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:17 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:17.216366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:17.226314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6300-8338-4a0b-98a2-51246975ce8a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:17.230885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:17.231786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:17.232075 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:17.232358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] PATH_INFO: `/v3/projects/31972ee08e4c44b0b86720ef9ba6e936/users/59793c7e8f55489295df7f8ed8f47e2e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:17.234348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=31972ee08e4c44b0b86720ef9ba6e936, user_id=59793c7e8f55489295df7f8ed8f47e2e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:17.237024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:17.247648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1114/2257] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:17 2021] PUT /identity/v3/projects/31972ee08e4c44b0b86720ef9ba6e936/users/59793c7e8f55489295df7f8ed8f47e2e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:17.834396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:17.834694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:17.835005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:17.865208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] MFA Rules not processed for user `59793c7e8f55489295df7f8ed8f47e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:17.866715 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:17.940513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1144/2258] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:17 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:18.935319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:18.994514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ba9e6-0388-4f42-8fde-54be2aa7d8fa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:18.999561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:19.000463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:19.000749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:19.001024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] PATH_INFO: `/v3/users/358823fb732e4fbdbbcb562d1407c56a` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:19.002211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358823fb732e4fbdbbcb562d1407c56a)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:19.004158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:19.046938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358823fb732e4fbdbbcb562d1407c56a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.053410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358823fb732e4fbdbbcb562d1407c56a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.054235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358823fb732e4fbdbbcb562d1407c56a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.066003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358823fb732e4fbdbbcb562d1407c56a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.072369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358823fb732e4fbdbbcb562d1407c56a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.078915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1115/2259] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:18:18 2021] DELETE /identity/v3/users/358823fb732e4fbdbbcb562d1407c56a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:19.248418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:19.259408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112c327-1453-4957-a22e-e565c40cffb8 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:19.334609 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:19.335394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:19.335711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:19.335995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] PATH_INFO: `/v3/projects/1a94cb091b134157a10708891b32940c` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:19.337173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a94cb091b134157a10708891b32940c)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:19.339060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:19.384902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a94cb091b134157a10708891b32940c', 'request_id': 'req-f0786c65-378c-406b-9831-70480cd82eed'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.392682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a94cb091b134157a10708891b32940c', 'request_id': 'req-f0786c65-378c-406b-9831-70480cd82eed'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.399008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a94cb091b134157a10708891b32940c', 'request_id': 'req-f0786c65-378c-406b-9831-70480cd82eed'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.408929 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] The token cache is being invalidate because project 1a94cb091b134157a10708891b32940c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:18:19.409220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.409848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.411570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1145/2260] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:18:19 2021] DELETE /identity/v3/projects/1a94cb091b134157a10708891b32940c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:19.415392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:19.416882 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:19.430054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b27aa3-2a40-43ff-8170-90b807651680 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:19.484019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:19.484896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:19.485401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:19.485700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] PATH_INFO: `/v3/users/59793c7e8f55489295df7f8ed8f47e2e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:19.486940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59793c7e8f55489295df7f8ed8f47e2e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:19.488885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:19.534023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59793c7e8f55489295df7f8ed8f47e2e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.540918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59793c7e8f55489295df7f8ed8f47e2e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.541537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59793c7e8f55489295df7f8ed8f47e2e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.553500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59793c7e8f55489295df7f8ed8f47e2e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.560124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-30815651-04ee-41bd-87ef-dcf396bd2816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59793c7e8f55489295df7f8ed8f47e2e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.565884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1116/2261] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:18:19 2021] DELETE /identity/v3/users/59793c7e8f55489295df7f8ed8f47e2e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:19.732210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:19.733644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:19.746257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0786c65-378c-406b-9831-70480cd82eed admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:19.803378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:19.804276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:19.804574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:19.804854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] PATH_INFO: `/v3/projects/31972ee08e4c44b0b86720ef9ba6e936` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:19.806053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31972ee08e4c44b0b86720ef9ba6e936)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:19.807984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:19.851595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31972ee08e4c44b0b86720ef9ba6e936', 'request_id': 'req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.859115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31972ee08e4c44b0b86720ef9ba6e936', 'request_id': 'req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.865226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31972ee08e4c44b0b86720ef9ba6e936', 'request_id': 'req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.875364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] The token cache is being invalidate because project 31972ee08e4c44b0b86720ef9ba6e936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:18:19.875677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.876337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f406cdef-da8f-4d3b-8fd8-42742ecd68e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:19.877845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1146/2262] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:18:19 2021] DELETE /identity/v3/projects/31972ee08e4c44b0b86720ef9ba6e936 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:19.883468 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:19.883805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:19.884092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:19.904088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:19.905277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:19.960539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1117/2263] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:19.968912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:19.969209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:19.969489 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:19.987094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:19.988306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:19.995949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1147/2264] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:19.999938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.009536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce979ec-cc70-4c20-bd8d-ecc9a7d828aa None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.015185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.015869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.016155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.016432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.017170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:18:20.017474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.019089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.030809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1118/2265] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:18:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:18:20.034977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.044261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4bd6d-d755-4253-93a7-6fd945e598c2 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.049349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.050008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.050301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.050584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.051297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.053282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.078474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1148/2266] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:18:20 2021] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:20.082664 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.093393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a98717-0336-4187-a90b-e237aa660d73 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.146701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.147359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.147673 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.147963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.148675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.150580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.170603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1119/2267] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:18:20 2021] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:20.174865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.186750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6732aa0-a302-423d-95be-914b990fd4da admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.191534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.192237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.192642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.192822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.193588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.195209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.206405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1149/2268] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:20.210272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.220153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430826f7-abeb-4059-9aed-a0c0f228beb8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.224759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a737c-4432-4c6d-8f60-f5d8c9f09b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.225411 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a737c-4432-4c6d-8f60-f5d8c9f09b4d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.225697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a737c-4432-4c6d-8f60-f5d8c9f09b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.225980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a737c-4432-4c6d-8f60-f5d8c9f09b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.226718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a737c-4432-4c6d-8f60-f5d8c9f09b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.228339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a737c-4432-4c6d-8f60-f5d8c9f09b4d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.237951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1120/2269] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:20.241896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.252093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aefbef-1de8-4202-8853-5e3b8e6ea25c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.257159 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.258032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.258318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.258595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] PATH_INFO: `/v3/projects/22a7f9383f0f43239b28d42a92683cbd/users/29cdba21f7e445f9b7af171349f0e27e/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.273871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a7f9383f0f43239b28d42a92683cbd, user_id=29cdba21f7e445f9b7af171349f0e27e, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.276577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.289654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1150/2270] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:20 2021] PUT /identity/v3/projects/22a7f9383f0f43239b28d42a92683cbd/users/29cdba21f7e445f9b7af171349f0e27e/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:20.301408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.301702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.301983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.329028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] MFA Rules not processed for user `29cdba21f7e445f9b7af171349f0e27e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:20.330246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:20.392040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1121/2271] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:20 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:18:20.396453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.455869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab20aa-3c43-43fd-b3ee-97627d9cdd93 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.460690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.461359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.461649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.461936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.462665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.464636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.493503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1151/2272] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:18:20 2021] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:18:20.498387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.509054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21d7296-57ff-4832-9f6a-e7899acf098f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.564238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.564916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.565200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.565475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.566190 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.568124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.587641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1122/2273] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:18:20 2021] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:18:20.591640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.601711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5ce71-719a-4e0e-8abc-e3bf51d2fd52 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.606830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.607577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.607902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.608187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.608961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.610585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.622481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1152/2274] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:20.626244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.635801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b734c88-3b50-429f-826f-defdfa787a8c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.640603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.641459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.641741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.642021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] PATH_INFO: `/v3/projects/50424fa85b694a27a53bbad2f535fb85/users/c98b078e189b4013a98a38b1d780d1ab/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.655921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50424fa85b694a27a53bbad2f535fb85, user_id=c98b078e189b4013a98a38b1d780d1ab, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.658474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.671351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1123/2275] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:20 2021] PUT /identity/v3/projects/50424fa85b694a27a53bbad2f535fb85/users/c98b078e189b4013a98a38b1d780d1ab/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:20.675072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.686157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4853e-7556-4c4e-918a-f5724257596e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.739541 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ac064-5c7a-4775-8d18-53b42c07129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.740548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac064-5c7a-4775-8d18-53b42c07129a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.740836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac064-5c7a-4775-8d18-53b42c07129a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.741113 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ac064-5c7a-4775-8d18-53b42c07129a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.741850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac064-5c7a-4775-8d18-53b42c07129a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.743791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ac064-5c7a-4775-8d18-53b42c07129a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.754171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1153/2276] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:20.758150 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.768422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0305fc-bb6a-4775-a37c-715dfb4a1be3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.773007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.773874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.774161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.774439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] PATH_INFO: `/v3/projects/50424fa85b694a27a53bbad2f535fb85/users/c98b078e189b4013a98a38b1d780d1ab/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.776419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50424fa85b694a27a53bbad2f535fb85, user_id=c98b078e189b4013a98a38b1d780d1ab, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.779029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.788929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1124/2277] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:20 2021] PUT /identity/v3/projects/50424fa85b694a27a53bbad2f535fb85/users/c98b078e189b4013a98a38b1d780d1ab/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:20.799530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.799848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.800126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.826079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] MFA Rules not processed for user `c98b078e189b4013a98a38b1d780d1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:20.827277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:20.890863 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1154/2278] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:20 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:18:20.901610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:20.903311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:20.957954 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f232c-682d-4797-820b-d6c4817a37f9 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:20.961538 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e08d6a-29ce-4fa5-a871-9c6bd685faa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:20.962174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e08d6a-29ce-4fa5-a871-9c6bd685faa1 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:20.962462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e08d6a-29ce-4fa5-a871-9c6bd685faa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:20.962745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e08d6a-29ce-4fa5-a871-9c6bd685faa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:20.972174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e08d6a-29ce-4fa5-a871-9c6bd685faa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:20.973615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e08d6a-29ce-4fa5-a871-9c6bd685faa1 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:20.983348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1125/2279] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:20 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:21.110607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:21.167986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65547-5eec-46f5-a743-a0a8b62bbe11 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:21.173054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:21.173925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:21.174208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:21.174512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] PATH_INFO: `/v3/users/29cdba21f7e445f9b7af171349f0e27e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:21.175716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cdba21f7e445f9b7af171349f0e27e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:21.177610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:21.221611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cdba21f7e445f9b7af171349f0e27e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.233883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cdba21f7e445f9b7af171349f0e27e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.234564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cdba21f7e445f9b7af171349f0e27e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.235173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cdba21f7e445f9b7af171349f0e27e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.242355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cdba21f7e445f9b7af171349f0e27e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.254525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1155/2280] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:18:21 2021] DELETE /identity/v3/users/29cdba21f7e445f9b7af171349f0e27e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:21.259213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:21.259505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:21.259814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:21.276881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:21.278575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:21.335260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1126/2281] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:21.345425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:21.347066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:21.403529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd84643-1264-4a13-98fe-c92c5b85e14b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:21.407187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:21.407867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:21.408155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:21.408437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:21.417111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:21.418523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:21.428357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1156/2282] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:21.685748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:21.687390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:21.703804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475612f-cb05-464a-9dad-d7a5623d6be4 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:21.709608 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:21.710297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:21.710584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:21.710925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] PATH_INFO: `/v3/projects/22a7f9383f0f43239b28d42a92683cbd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:21.712106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a7f9383f0f43239b28d42a92683cbd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:21.714287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:21.758271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a7f9383f0f43239b28d42a92683cbd', 'request_id': 'req-c7053f2e-69ca-4b56-b36e-7b922907ba91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.764975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a7f9383f0f43239b28d42a92683cbd', 'request_id': 'req-c7053f2e-69ca-4b56-b36e-7b922907ba91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.771743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a7f9383f0f43239b28d42a92683cbd', 'request_id': 'req-c7053f2e-69ca-4b56-b36e-7b922907ba91'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.781881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] The token cache is being invalidate because project 22a7f9383f0f43239b28d42a92683cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:18:21.782171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.782788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.784323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1127/2283] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:18:21 2021] DELETE /identity/v3/projects/22a7f9383f0f43239b28d42a92683cbd => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:21.788207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:21.797437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bbef6-0849-4ba5-be01-14460a15174c service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:21.851112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:21.852029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:21.852310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:21.852583 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] PATH_INFO: `/v3/users/c98b078e189b4013a98a38b1d780d1ab` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:21.853769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98b078e189b4013a98a38b1d780d1ab)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:21.855698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:21.897639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98b078e189b4013a98a38b1d780d1ab'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.909033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98b078e189b4013a98a38b1d780d1ab'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.909678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98b078e189b4013a98a38b1d780d1ab'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.910295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98b078e189b4013a98a38b1d780d1ab'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.917228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-6735064c-1d97-4527-88c1-5e676b43e4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98b078e189b4013a98a38b1d780d1ab'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:21.928871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1157/2284] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:18:21 2021] DELETE /identity/v3/users/c98b078e189b4013a98a38b1d780d1ab => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:22.174593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.176047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:22.189953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7053f2e-69ca-4b56-b36e-7b922907ba91 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.248876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.249723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.250004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.250278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] PATH_INFO: `/v3/projects/50424fa85b694a27a53bbad2f535fb85` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.251455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50424fa85b694a27a53bbad2f535fb85)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.253387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.298440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50424fa85b694a27a53bbad2f535fb85', 'request_id': 'req-102c1806-ccd4-4096-90a9-25aca6916e02'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:22.304472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50424fa85b694a27a53bbad2f535fb85', 'request_id': 'req-102c1806-ccd4-4096-90a9-25aca6916e02'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:22.312630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50424fa85b694a27a53bbad2f535fb85', 'request_id': 'req-102c1806-ccd4-4096-90a9-25aca6916e02'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:22.324324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] The token cache is being invalidate because project 50424fa85b694a27a53bbad2f535fb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:18:22.324618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:22.325254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-102c1806-ccd4-4096-90a9-25aca6916e02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:18:22.326768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1128/2285] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:18:22 2021] DELETE /identity/v3/projects/50424fa85b694a27a53bbad2f535fb85 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:18:22.333758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.334250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.334372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.351636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:22.352856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:22.412112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1158/2286] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:22.421684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.421972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.422248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.441074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:22.442243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:22.450228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1129/2287] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:22.454266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.463573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1e714-9087-4093-a4b8-6f5e96205081 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.468679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.469335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.469619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.469898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.470639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:18:22.470946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.472543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.484403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1159/2288] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:18:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:18:22.488685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.497642 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a0fb4-9fe5-451b-9778-bea45949d32b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.502206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.502841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.503126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.503402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.504147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.506065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.530494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1130/2289] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:22.534578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.544882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52abe0-3e51-4a1e-a1d7-ee803af10d20 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.598444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.599103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.599387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.599689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.600391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.602280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.621347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1160/2290] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:18:22.625559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.635480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69901ac2-f972-4acb-a6ac-a871e6011142 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.640342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.640992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.641282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.641561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.642296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.643900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.654295 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1131/2291] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:22.657913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.667432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6441d-2e2b-44d7-9173-7bd89ed6e440 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.672517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8351b-f4a4-4811-af5c-98e02cd742bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.673191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8351b-f4a4-4811-af5c-98e02cd742bf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.673474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8351b-f4a4-4811-af5c-98e02cd742bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.673767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8351b-f4a4-4811-af5c-98e02cd742bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.674488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8351b-f4a4-4811-af5c-98e02cd742bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.676092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8351b-f4a4-4811-af5c-98e02cd742bf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.685675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1161/2292] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:22 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:22.689467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.699182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa680f8-15e5-4f35-ae28-2cda54c8460c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.703784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.704645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.704927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.705204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] PATH_INFO: `/v3/projects/81a08c0c12f64cfa8bd646d9b56abddf/users/2aeaed1cf43148c6b399ee2799be9464/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.719516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a08c0c12f64cfa8bd646d9b56abddf, user_id=2aeaed1cf43148c6b399ee2799be9464, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.722167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.735811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1132/2293] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:22 2021] PUT /identity/v3/projects/81a08c0c12f64cfa8bd646d9b56abddf/users/2aeaed1cf43148c6b399ee2799be9464/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:18:22.745692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.745993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.746306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.771708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] MFA Rules not processed for user `2aeaed1cf43148c6b399ee2799be9464`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:22.772913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:22.839077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1162/2294] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:22.844149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.902131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ddadb-24a3-455b-930b-6c7231c208a0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:22.907444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:22.908124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:22.908410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:22.908689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:22.909394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:22.911293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:22.934869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1133/2295] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:22.938860 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:22.949147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6fea4-912f-49c0-a93e-930e0722f257 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:23.002952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:23.003636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.003938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.004217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.004920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:23.006845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:23.026025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1163/2296] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:18:22 2021] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:18:23.030511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:23.040458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd205973-9ab4-4bd8-b686-e344dd91b77b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:23.045083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:23.045734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.046023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.046301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.047034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:23.048655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:23.058726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1134/2297] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:23.062529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:23.072221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722f5b-8198-46ff-9f74-ac32cbc5c7f4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:23.077315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:23.078184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.078471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.078777 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] PATH_INFO: `/v3/projects/88427282cab844b493095b9f9447140e/users/384db4ef702c4208ac47abc33cf207e6/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.094000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88427282cab844b493095b9f9447140e, user_id=384db4ef702c4208ac47abc33cf207e6, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:23.096648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:23.108658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1164/2298] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:23 2021] PUT /identity/v3/projects/88427282cab844b493095b9f9447140e/users/384db4ef702c4208ac47abc33cf207e6/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:18:23.112435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:23.122079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b53b-5ab4-4a7a-871f-a4399273ccf3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:23.175699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84023645-3f07-487b-994c-ad5e6bf09c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:23.176359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84023645-3f07-487b-994c-ad5e6bf09c71 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.176645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84023645-3f07-487b-994c-ad5e6bf09c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.176955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84023645-3f07-487b-994c-ad5e6bf09c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.177692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84023645-3f07-487b-994c-ad5e6bf09c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:23.179290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84023645-3f07-487b-994c-ad5e6bf09c71 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:23.189734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1135/2299] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:18:23.193831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:23.204283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0146d4e-98d6-4cb8-9810-de9ae05abc3f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:23.208799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:23.209663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.209947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.210222 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] PATH_INFO: `/v3/projects/88427282cab844b493095b9f9447140e/users/384db4ef702c4208ac47abc33cf207e6/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.212205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88427282cab844b493095b9f9447140e, user_id=384db4ef702c4208ac47abc33cf207e6, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:23.214819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:23.224691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1165/2300] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:18:23 2021] PUT /identity/v3/projects/88427282cab844b493095b9f9447140e/users/384db4ef702c4208ac47abc33cf207e6/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:18:23.234388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.234684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.234967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.262943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] MFA Rules not processed for user `384db4ef702c4208ac47abc33cf207e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:18:23.264434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:23.328933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1136/2301] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:18:23 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:18:23.338519 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:23.340241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:23.395476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f2bc2-4437-4b7d-a5d0-0fff90175586 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:23.399149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:23.399833 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:23.400123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:23.400404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:23.453447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:23.454905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:23.463466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1166/2302] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:23 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:18:33.167526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:18:33.179267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6f25b-8533-44de-89e2-2c6859079d6e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:18:33.183021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:18:33.183687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:18:33.183974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:18:33.184249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:18:33.186417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:18:33.243395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:18:33.244872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:18:33.253639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1137/2303] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:18:33 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:20:55.416311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:20:55.417688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:20:55.539689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856715b-dbbb-49ff-a665-68f76e0c1c8f service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:20:55.544657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:20:55.545299 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:20:55.545595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:20:55.545877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:20:55.548183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:20:55.559340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:20:55.560953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:20:55.570526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1167/2304] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:20:55 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:20:56.256505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:20:56.257962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:20:56.362192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13c82-779f-4c80-8d2d-d55495202788 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:20:56.367776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:20:56.368422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:20:56.368712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:20:56.368993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:20:56.370742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:20:56.383555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:20:56.385188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:20:56.395706 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1138/2305] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:20:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:21:39.910321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:21:39.937834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333e43-c92c-46c3-8e54-b7f1f91540dc service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:21:39.942082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:21:39.942718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:21:39.943005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:21:39.943279 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:21:39.945044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:21:40.021776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:21:40.023234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:21:40.040577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1168/2306] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:21:39 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:21:40.159425 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:21:40.179135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2112a3-da0c-4566-8b90-6918c521215a service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:21:40.182616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:21:40.183274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:21:40.183557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:21:40.183862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:21:40.185816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:21:40.251217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:21:40.252667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:21:40.270080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1139/2307] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:21:40 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:23:04.986211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:23:04.987724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:05.010631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd321b9-a370-4f8b-9b6d-a166132fbe51 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:23:05.014153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:23:05.014784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:23:05.015067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:23:05.015340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:23:05.017031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:05.092991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:23:05.094419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:23:05.111728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1169/2308] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:23:04 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:23:06.854816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:23:06.856210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:06.930355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2cb467-4f50-4adf-8e7e-23eafc0a4fab service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:23:06.934046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:23:06.934685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:23:06.934972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:23:06.935252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:23:06.937036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:06.946228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:23:06.947660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:23:06.955817 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1140/2309] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:23:06 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:23:23.768093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:23:23.776295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc58c57-c868-4149-a5bf-e59dab09690e service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:23:23.779851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:23:23.780483 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:23:23.780768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:23:23.781045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:23:23.789118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:23:23.790529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:23:23.798909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1170/2310] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:23:23 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:23:33.355029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:23:33.364599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbbdf7-74fe-4b53-b80d-fed12b43443f service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:23:33.368159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:23:33.368794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:23:33.369079 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:23:33.369357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:23:33.378191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:23:33.379610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:23:33.406244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1141/2311] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:23:33 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:23:54.230151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:23:54.241683 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0eb06-86d4-420b-9165-979ff6a7d39f service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:23:54.247565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:23:54.248254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:23:54.248538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:23:54.248817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:23:54.250590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:54.272130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:23:54.273548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:23:54.295307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1171/2312] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:23:54 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:23:55.471347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:23:55.472919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:55.484777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c01882-94d4-44f0-96f4-669bb0841a92 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:23:55.488937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:23:55.489577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:23:55.489860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:23:55.490139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:23:55.491943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:23:55.510259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:23:55.511641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03524735-0585-46af-b7d9-1fe86eb2153b service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:23:55.523878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1142/2313] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:23:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:25:59.074567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:25:59.134447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea313cac-56a4-4cec-998b-26f075c2f214 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:25:59.138987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:25:59.139972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:25:59.140262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:25:59.140546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] PATH_INFO: `/v3/users/2aeaed1cf43148c6b399ee2799be9464` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:25:59.141759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aeaed1cf43148c6b399ee2799be9464)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:25:59.143718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:25:59.191047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aeaed1cf43148c6b399ee2799be9464'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.203157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aeaed1cf43148c6b399ee2799be9464'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.203869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aeaed1cf43148c6b399ee2799be9464'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.204493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aeaed1cf43148c6b399ee2799be9464'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.212130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aeaed1cf43148c6b399ee2799be9464'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.224921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1172/2314] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:25:59 2021] DELETE /identity/v3/users/2aeaed1cf43148c6b399ee2799be9464 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:25:59.229583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:25:59.230149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:25:59.230149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:25:59.249615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:25:59.251039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:25:59.329730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1143/2315] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:25:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:25:59.337498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:25:59.339000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:25:59.410296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad963a-1101-479f-a389-6dce0934f520 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:25:59.413846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:25:59.414488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:25:59.414770 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:25:59.415045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:25:59.423731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:25:59.425163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:25:59.434912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1173/2316] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:25:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:25:59.685552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:25:59.686983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:25:59.699052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1036c6-e50e-4d91-a1ff-ff1d1e9a7064 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:25:59.703578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:25:59.704466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:25:59.704748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:25:59.705109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] PATH_INFO: `/v3/projects/81a08c0c12f64cfa8bd646d9b56abddf` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:25:59.706312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a08c0c12f64cfa8bd646d9b56abddf)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:25:59.708277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:25:59.756943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a08c0c12f64cfa8bd646d9b56abddf', 'request_id': 'req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.763374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a08c0c12f64cfa8bd646d9b56abddf', 'request_id': 'req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.771765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a08c0c12f64cfa8bd646d9b56abddf', 'request_id': 'req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.782632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] The token cache is being invalidate because project 81a08c0c12f64cfa8bd646d9b56abddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:25:59.782924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.783552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.785910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1144/2317] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:25:59 2021] DELETE /identity/v3/projects/81a08c0c12f64cfa8bd646d9b56abddf => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:25:59.789774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:25:59.799251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b656fd-c9ed-4fac-bc14-4d3e19c69688 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:25:59.852441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:25:59.853229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:25:59.853518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:25:59.853795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] PATH_INFO: `/v3/users/384db4ef702c4208ac47abc33cf207e6` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:25:59.854990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384db4ef702c4208ac47abc33cf207e6)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:25:59.856925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:25:59.900985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384db4ef702c4208ac47abc33cf207e6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.912959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384db4ef702c4208ac47abc33cf207e6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.913631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384db4ef702c4208ac47abc33cf207e6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.914243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384db4ef702c4208ac47abc33cf207e6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.921498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c001155-b110-4084-abb3-f65cc2ae16f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384db4ef702c4208ac47abc33cf207e6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:25:59.933194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1174/2318] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:25:59 2021] DELETE /identity/v3/users/384db4ef702c4208ac47abc33cf207e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:26:00.190007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.191450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:00.204408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4d780-fb0b-4efa-a870-e65e8a4fadbd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.260051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.260911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.261197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.261477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] PATH_INFO: `/v3/projects/88427282cab844b493095b9f9447140e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.262670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88427282cab844b493095b9f9447140e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.264619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.308918 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88427282cab844b493095b9f9447140e', 'request_id': 'req-987a515f-0e1b-4b02-acaf-ee6fd69540b1'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:26:00.314863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88427282cab844b493095b9f9447140e', 'request_id': 'req-987a515f-0e1b-4b02-acaf-ee6fd69540b1'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:26:00.322512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88427282cab844b493095b9f9447140e', 'request_id': 'req-987a515f-0e1b-4b02-acaf-ee6fd69540b1'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:26:00.332970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] The token cache is being invalidate because project 88427282cab844b493095b9f9447140e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:26:00.333256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:26:00.333876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-987a515f-0e1b-4b02-acaf-ee6fd69540b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:26:00.335368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1145/2319] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:26:00 2021] DELETE /identity/v3/projects/88427282cab844b493095b9f9447140e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:26:00.342210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.342697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.342809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.360117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:26:00.361338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:00.421245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1175/2320] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:26:00.429347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.429643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.429943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.447893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:26:00.449114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:00.457467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1146/2321] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:26:00.461440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.470904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c7e5e-54c9-48de-b4e2-3b36f2770dcd None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.475427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.476128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.476416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.476698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.477444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:26:00.477782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.479383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.490997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1176/2322] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:26:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:26:00.494992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.504742 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb851267-86eb-4de6-b0cd-b78598fd18bf None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.509599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.510236 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.510520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.510800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.511505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.513438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.539942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1147/2323] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:26:00.543920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.554118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff558f0-e8fa-48af-9535-e264f8088c5c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.607701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.608414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.608705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.609015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.609752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.611694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.635163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1177/2324] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:26:00.636354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.647015 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5544-a695-433e-8df5-eed0c93cb348 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.651487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.652161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.652442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.652713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.653441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.654999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.665826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1148/2325] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:26:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:26:00.669718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.679752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c8d06-b925-44dc-84ba-5ef8a4e734a0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.684572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3f9f8e-285d-49f5-9894-78f0c9d19709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.685226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f9f8e-285d-49f5-9894-78f0c9d19709 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.685512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f9f8e-285d-49f5-9894-78f0c9d19709 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.685812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f9f8e-285d-49f5-9894-78f0c9d19709 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.686549 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f9f8e-285d-49f5-9894-78f0c9d19709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.688237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3f9f8e-285d-49f5-9894-78f0c9d19709 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.698039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1178/2326] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:26:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:26:00.701934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.712237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d970c5-81dc-4b50-b447-9999740ebebc admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.716764 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.717618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.717898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.718170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] PATH_INFO: `/v3/projects/d58b1086f033402baa54d7f22d417af4/users/bf4bfb41207e48faaf73df96ae5d7445/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.732485 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d58b1086f033402baa54d7f22d417af4, user_id=bf4bfb41207e48faaf73df96ae5d7445, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.735089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.747694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1149/2327] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:26:00 2021] PUT /identity/v3/projects/d58b1086f033402baa54d7f22d417af4/users/bf4bfb41207e48faaf73df96ae5d7445/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:26:00.758384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.758685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.759002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.785971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] MFA Rules not processed for user `bf4bfb41207e48faaf73df96ae5d7445`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:26:00.787163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:00.850180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1179/2328] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:26:00.854704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.918436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae26e7-d504-403d-89e3-cbf467cfc23c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:00.926140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:00.926792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:00.927072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:00.927346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:00.928099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:00.929977 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:00.953372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1150/2329] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:26:00.957473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:00.967760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a767b-855c-44b2-a92e-6aedf91bf1b7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:01.021051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:01.021710 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:01.021994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:01.022273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:01.022980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:01.024908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:01.043876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1180/2330] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:26:00 2021] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:26:01.047861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:01.058457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d305da-14f4-445e-b4ee-afed20614951 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:01.068199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:01.068868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:01.069150 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:01.069423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:01.070195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:01.071809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:01.082531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1151/2331] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:26:01 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:26:01.086716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:01.096565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ecb829-8d7c-475f-b2e5-4b6e39fc489b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:01.102337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:01.103216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:01.103503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:01.103882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] PATH_INFO: `/v3/projects/d300a7d7b29746f1b84b9283b087738a/users/73f062931965438390e42a68021032ac/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:01.118718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d300a7d7b29746f1b84b9283b087738a, user_id=73f062931965438390e42a68021032ac, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:01.121389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:01.134527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1181/2332] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:26:01 2021] PUT /identity/v3/projects/d300a7d7b29746f1b84b9283b087738a/users/73f062931965438390e42a68021032ac/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:26:01.138352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:01.147980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb4405-1696-4f46-8c94-1bd01661f2aa admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:01.201917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1e14f-be61-4b20-8f68-e0a38e973fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:01.202502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e14f-be61-4b20-8f68-e0a38e973fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:01.202786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e14f-be61-4b20-8f68-e0a38e973fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:01.203062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1e14f-be61-4b20-8f68-e0a38e973fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:01.203833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e14f-be61-4b20-8f68-e0a38e973fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:01.205418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1e14f-be61-4b20-8f68-e0a38e973fbb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:01.215392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1152/2333] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:26:01 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:26:01.219539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:01.229701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a66e83-6e92-4f39-88ef-58de6e181e9e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:01.234284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:01.235184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:01.235473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:01.235792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] PATH_INFO: `/v3/projects/d300a7d7b29746f1b84b9283b087738a/users/73f062931965438390e42a68021032ac/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:01.238307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d300a7d7b29746f1b84b9283b087738a, user_id=73f062931965438390e42a68021032ac, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:01.240968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:01.250934 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1182/2334] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:26:01 2021] PUT /identity/v3/projects/d300a7d7b29746f1b84b9283b087738a/users/73f062931965438390e42a68021032ac/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:26:01.301618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:01.302193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:01.302193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:01.327925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] MFA Rules not processed for user `73f062931965438390e42a68021032ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:26:01.329115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:01.392359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1153/2335] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:26:01 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:26:04.123464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:04.125182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:04.195335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43cf14-1814-4577-9463-a84ad32ab2cd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:04.200360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:04.201008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:04.201296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:04.201577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:04.203329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:04.214263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:04.215851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:04.225991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1183/2336] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:26:04 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:26:41.262013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:41.263390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:41.343725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45786a4-7021-4355-bf1c-c3520577ef03 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:41.349716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:41.350353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:41.350634 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:41.350908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:41.352655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:41.417704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:41.419283 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:41.428579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1154/2337] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:26:41 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:26:56.567456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:56.569166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:56.622037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9b9e2-7b10-4d19-9cb4-fbd7ef81e96e service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:56.625619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:56.626258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:56.626544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:56.626825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:56.628550 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:56.683969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:56.685385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:56.694891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1184/2338] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:26:56 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:26:56.778053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:56.787371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea9bc5-cdaa-4129-b7aa-e490b26b825b service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:56.790923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:56.791579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:56.792302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:56.792302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:56.802686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:56.804337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:56.812247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:26:56.813661 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:56.816459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1155/2339] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:26:56 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:26:56.877426 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c123f-13f7-4d41-b779-20aae14c8f20 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:26:56.882277 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:26:56.882995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:26:56.883306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:26:56.883584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:26:56.885544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:26:56.953810 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:26:56.955494 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:26:56.966596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1185/2340] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:26:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:27:00.115759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.118434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:00.133656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb45963-1a16-4fa6-9219-d4b5d0572444 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.140160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.141114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.141623 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.142122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] PATH_INFO: `/v3/users/115a975a272c4ad9a5e93a38ee1c8180` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.143769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115a975a272c4ad9a5e93a38ee1c8180)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.145781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.192898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115a975a272c4ad9a5e93a38ee1c8180'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.200497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115a975a272c4ad9a5e93a38ee1c8180'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.201117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115a975a272c4ad9a5e93a38ee1c8180'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.212661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115a975a272c4ad9a5e93a38ee1c8180'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.219483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8aa65053-fe04-4459-96b6-6553bab40f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115a975a272c4ad9a5e93a38ee1c8180'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.226131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1156/2341] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:27:00 2021] DELETE /identity/v3/users/115a975a272c4ad9a5e93a38ee1c8180 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:27:00.411990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.421962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1907b-2844-4308-a514-fe9e2a8feaf7 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.479377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.480280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.480570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.480853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] PATH_INFO: `/v3/projects/df921510edf34ac09f5be957837f5546` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.482074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=df921510edf34ac09f5be957837f5546)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.484050 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.531394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df921510edf34ac09f5be957837f5546', 'request_id': 'req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.540207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df921510edf34ac09f5be957837f5546', 'request_id': 'req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.547019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df921510edf34ac09f5be957837f5546', 'request_id': 'req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.558371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] The token cache is being invalidate because project df921510edf34ac09f5be957837f5546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:27:00.558687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.559369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-0f1bbcc3-c165-40f9-afa0-4f9417663ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:27:00.561175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1186/2342] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:27:00 2021] DELETE /identity/v3/projects/df921510edf34ac09f5be957837f5546 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:27:00.567555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.567888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.568170 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.587034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:27:00.588270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:00.647506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1157/2343] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:27:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:27:00.655393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.655612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.655921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.674403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:27:00.675580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:00.683447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1187/2344] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:27:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:27:00.687607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.697230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca32e48-5b79-402c-abbe-eb6853513287 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.701699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.702339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.702621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.702893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.703643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:27:00.703955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.705556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.717326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1158/2345] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:27:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:27:00.721068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.730622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0204a3ff-1fb8-4c74-a289-3f4a10331803 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.735186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.735844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.736153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.736427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.737136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.739022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.764225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1188/2346] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:27:00 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:27:00.768534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.778714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5bce8-68bc-4f18-bb73-220a28e784fe admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.834298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.835032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.835325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.835612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.836359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.838276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.858781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1159/2347] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:27:00 2021] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:27:00.862784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.872771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea29f10-fa9a-4d7f-96ec-1fe88281e533 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.877404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.878061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.878345 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.878621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.880164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.881741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.891965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1189/2348] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:27:00.896662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.906662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aba1fd-4930-4193-ab7b-22497dfc25c4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.911193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc0997-b485-46f8-b310-0823d1d7ba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.911886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc0997-b485-46f8-b310-0823d1d7ba9b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.912173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc0997-b485-46f8-b310-0823d1d7ba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.912451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc0997-b485-46f8-b310-0823d1d7ba9b admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.913198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc0997-b485-46f8-b310-0823d1d7ba9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.914787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc0997-b485-46f8-b310-0823d1d7ba9b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.928416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1160/2349] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:27:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:27:00.929562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:00.940428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e9fb6-80bc-4df1-a6aa-3fbd6283ddbf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:00.946936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:00.947856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.948142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.948418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] PATH_INFO: `/v3/projects/79c23581254b4a1b8e14762a8370a847/users/587a246fe3b7411cb12c60bdd46fb265/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:00.965584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c23581254b4a1b8e14762a8370a847, user_id=587a246fe3b7411cb12c60bdd46fb265, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:00.968292 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:00.980869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1190/2350] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:27:00 2021] PUT /identity/v3/projects/79c23581254b4a1b8e14762a8370a847/users/587a246fe3b7411cb12c60bdd46fb265/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:27:00.991353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:00.991675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:00.991990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:01.019092 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] MFA Rules not processed for user `587a246fe3b7411cb12c60bdd46fb265`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:27:01.020839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:01.081365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1161/2351] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:27:00 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:27:01.093150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:01.094794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:01.166089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87403fa1-98c0-44c0-b141-d85f156a3d20 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:01.171775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:01.172685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:01.172968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:01.173243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:01.181376 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:01.183015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:01.191765 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1191/2352] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:27:01 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:27:59.834475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:27:59.835945 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:59.891984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d18d62-b02b-49d8-b806-8318e3b60863 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:27:59.895668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:27:59.896312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:27:59.896601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:27:59.896889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:27:59.898655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:27:59.957726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:27:59.959279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6381f-42a8-4692-b6ec-89f4d5955579 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:27:59.968496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1162/2353] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:27:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:28:01.151998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:01.162313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685137be-e713-4d07-838e-4a58e0c92178 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:01.166749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:01.168051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:01.168051 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:01.168296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] PATH_INFO: `/v3/users/587a246fe3b7411cb12c60bdd46fb265` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:01.169720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=587a246fe3b7411cb12c60bdd46fb265)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:01.171251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:01.216911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587a246fe3b7411cb12c60bdd46fb265'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.228467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587a246fe3b7411cb12c60bdd46fb265'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.229166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587a246fe3b7411cb12c60bdd46fb265'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.229778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587a246fe3b7411cb12c60bdd46fb265'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.238013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587a246fe3b7411cb12c60bdd46fb265'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.250368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1192/2354] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:28:01 2021] DELETE /identity/v3/users/587a246fe3b7411cb12c60bdd46fb265 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:28:01.255705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:01.256208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:01.256329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:01.272932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:01.274180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:01.335286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1163/2355] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:01.345801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:01.347200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:01.406403 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeec05f-3d78-44d1-a1f4-1fba0c67bed9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:01.410158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb84730-1058-480b-a2ce-7be944c07fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:01.410890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb84730-1058-480b-a2ce-7be944c07fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:01.411233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb84730-1058-480b-a2ce-7be944c07fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:01.411936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb84730-1058-480b-a2ce-7be944c07fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:01.421789 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb84730-1058-480b-a2ce-7be944c07fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:01.423319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb84730-1058-480b-a2ce-7be944c07fc3 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:01.433610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1193/2356] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:28:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:28:01.861964 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:01.863444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:01.875944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a21e-f737-4f61-96cf-128394afaf06 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:01.884060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:01.884937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:01.885246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:01.885503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] PATH_INFO: `/v3/projects/79c23581254b4a1b8e14762a8370a847` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:01.886725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c23581254b4a1b8e14762a8370a847)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:01.888865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:01.939106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c23581254b4a1b8e14762a8370a847', 'request_id': 'req-f8f052af-e9cf-49ee-803b-b78db5603973'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.945986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c23581254b4a1b8e14762a8370a847', 'request_id': 'req-f8f052af-e9cf-49ee-803b-b78db5603973'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.956526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c23581254b4a1b8e14762a8370a847', 'request_id': 'req-f8f052af-e9cf-49ee-803b-b78db5603973'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.972713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] The token cache is being invalidate because project 79c23581254b4a1b8e14762a8370a847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:28:01.973001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.973683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f8f052af-e9cf-49ee-803b-b78db5603973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:01.975437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1164/2357] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:28:01 2021] DELETE /identity/v3/projects/79c23581254b4a1b8e14762a8370a847 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:28:01.981662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:01.981950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:01.982264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.003463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:02.005066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:02.068240 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1194/2358] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:02.077213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.077580 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.077929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.097155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:02.098364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:02.109797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1165/2359] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:02.110707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:02.120381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8ef28-2f2b-43d7-9265-0b399bc522c7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:02.124971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:02.125646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.125915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.126196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.126991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:28:02.127305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:02.129251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:02.140998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1195/2360] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:28:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:28:02.145781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:02.154600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6684a4-f823-4f15-b05a-9b4a08ceb5e2 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:02.160293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:02.160947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.161229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.161507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.162226 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:02.164210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:02.189148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1166/2361] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:28:02 2021] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:28:02.193259 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:02.203835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf4fd0-4da2-413a-8482-4207f4a1cb4e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:02.260017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:02.260822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.261110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.261461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.262217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:02.264044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:02.292184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1196/2362] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:28:02 2021] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:28:02.293516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:02.309857 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbc843-e13b-4ce2-a823-172bf5b67d24 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:02.315521 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:02.316252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.316533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.316807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.317744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:02.319524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:02.332398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1167/2363] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:28:02 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:28:02.337023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:02.349334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062788e-0cc9-458d-b733-a299e469c241 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:02.355535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050405fe-c9b1-4786-82a4-36d57a35a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:02.355535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050405fe-c9b1-4786-82a4-36d57a35a67a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.355535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050405fe-c9b1-4786-82a4-36d57a35a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.355535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050405fe-c9b1-4786-82a4-36d57a35a67a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.356186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050405fe-c9b1-4786-82a4-36d57a35a67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:02.357795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050405fe-c9b1-4786-82a4-36d57a35a67a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:02.371657 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1197/2364] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:28:02 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:28:02.374754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:02.385510 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f47b75-55e4-4ac0-b5d5-88b738e3d5df admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:02.390030 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:02.390903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.391183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.391456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] PATH_INFO: `/v3/projects/28271f8ffe50468b86ebf36c41287cbb/users/247089073e0e4975ac31c5e9cc03afc2/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.406594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28271f8ffe50468b86ebf36c41287cbb, user_id=247089073e0e4975ac31c5e9cc03afc2, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:02.409462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:02.422826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1168/2365] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:28:02 2021] PUT /identity/v3/projects/28271f8ffe50468b86ebf36c41287cbb/users/247089073e0e4975ac31c5e9cc03afc2/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:28:02.433080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:02.433374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:02.433659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:02.460423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] MFA Rules not processed for user `247089073e0e4975ac31c5e9cc03afc2`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:02.461563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:02.525903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1198/2366] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:02 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:03.392919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:03.394685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:03.461299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86a66-feb1-4f5e-be37-381d926497b0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:03.465765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:03.466649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:03.466929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:03.467201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] PATH_INFO: `/v3/users/07d92b2e7b1b46f6916c335b25a44ecf` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:03.468406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d92b2e7b1b46f6916c335b25a44ecf)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:03.470310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:03.515077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d92b2e7b1b46f6916c335b25a44ecf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.522191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d92b2e7b1b46f6916c335b25a44ecf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.522901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d92b2e7b1b46f6916c335b25a44ecf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.534771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d92b2e7b1b46f6916c335b25a44ecf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.541348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fc169f15-a619-421e-83bb-4940118b5e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d92b2e7b1b46f6916c335b25a44ecf'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.546992 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1169/2367] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:28:03 2021] DELETE /identity/v3/users/07d92b2e7b1b46f6916c335b25a44ecf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:28:03.712382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:03.725721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c9141a-4c11-4a4e-b6c3-5441af38e5a2 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:03.780672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:03.781533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:03.781824 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:03.782108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] PATH_INFO: `/v3/projects/acf465ea6c244dcaa76ca3817fc6801f` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:03.783924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acf465ea6c244dcaa76ca3817fc6801f)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:03.785832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:03.832164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acf465ea6c244dcaa76ca3817fc6801f', 'request_id': 'req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.840524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acf465ea6c244dcaa76ca3817fc6801f', 'request_id': 'req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.847190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acf465ea6c244dcaa76ca3817fc6801f', 'request_id': 'req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.857447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] The token cache is being invalidate because project acf465ea6c244dcaa76ca3817fc6801f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:28:03.857737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.858410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fde0fb40-0a77-4468-b6a2-d6cc88bd7a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:28:03.860120 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1199/2368] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:28:03 2021] DELETE /identity/v3/projects/acf465ea6c244dcaa76ca3817fc6801f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:28:03.866834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:03.867187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:03.867478 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:03.885531 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:03.886731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:03.945120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1170/2369] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:03.953204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:03.953503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:03.953787 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:03.972285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:03.973482 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:03.981223 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1200/2370] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:03.985231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:03.994916 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e35ef0-a2ff-4eee-a210-38e9825c3bb3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:03.999390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.000058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.000341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.000616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.001356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:28:04.001662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.004043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.014968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1171/2371] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:28:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:28:04.019599 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.028479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e59b0-7c56-491e-8480-71f34639fdad None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.033053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.033697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.034036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.034323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.035038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.037026 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.068462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1201/2372] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:28:04 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:28:04.072605 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.082987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0a034-dd36-46e2-9631-ed864df68221 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.136890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.137559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.137850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.138133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.138849 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.140804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.160358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1172/2373] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:28:04 2021] POST /identity/v3/users => generated 286 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:28:04.164644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.175310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ac5e-52ee-4334-96ec-831d513de735 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.180064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.180724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.181014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.181297 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.182040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.183654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.194577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1202/2374] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:28:04.198108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.207920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32b3c7-4898-4008-949b-9097c2e0c8a0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.212576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e1747-fdc3-496d-b052-fb0e1d5fe775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.213228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e1747-fdc3-496d-b052-fb0e1d5fe775 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.213516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e1747-fdc3-496d-b052-fb0e1d5fe775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.213801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e1747-fdc3-496d-b052-fb0e1d5fe775 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.214545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e1747-fdc3-496d-b052-fb0e1d5fe775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.216173 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e1747-fdc3-496d-b052-fb0e1d5fe775 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.225696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1173/2375] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:28:04.229572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.239643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90107dd-969f-4898-85b3-5c3a11d5c591 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.244256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.245144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.245427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.245704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] PATH_INFO: `/v3/projects/e4b4a0b493294a289a62943ddf493b39/users/b6894097b4c24be3b57e88c3cfbe51cb/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.260474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b4a0b493294a289a62943ddf493b39, user_id=b6894097b4c24be3b57e88c3cfbe51cb, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.263114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.275407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1203/2376] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:28:04 2021] PUT /identity/v3/projects/e4b4a0b493294a289a62943ddf493b39/users/b6894097b4c24be3b57e88c3cfbe51cb/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:28:04.285240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.285533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.285814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.311868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] MFA Rules not processed for user `b6894097b4c24be3b57e88c3cfbe51cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:04.313062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:04.376111 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1174/2377] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:04 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:04.381363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.440931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe9d2f4-e4c0-49cf-89ea-db345da2acea admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.445653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.446337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.446621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.446898 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.447637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.449557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.473367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1204/2378] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:28:04 2021] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:28:04.477353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.488164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7159cbf-32ff-4d90-9e2d-9f5b6613e174 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.541629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.542289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.542569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.542842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.543551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.545489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.565901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1175/2379] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:28:04 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:28:04.569761 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.579607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd7cf-09a1-445a-b5f0-d7eed7d29e32 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.584144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.584792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.585076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.585353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.586087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.587686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.598313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1205/2380] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:28:04.602396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.612887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434f43b-8f79-4da6-a315-52af2e674ad4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.617636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.618509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.618794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.619073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] PATH_INFO: `/v3/projects/0da817f1905a4f8683dd629b0e873b81/users/1abedbad7ae94421a46120b10a3a06a6/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.633852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da817f1905a4f8683dd629b0e873b81, user_id=1abedbad7ae94421a46120b10a3a06a6, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.636476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.649578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1176/2381] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:28:04 2021] PUT /identity/v3/projects/0da817f1905a4f8683dd629b0e873b81/users/1abedbad7ae94421a46120b10a3a06a6/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:28:04.653410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.663402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366e81e-fb22-488f-a5f4-ed21c0b9967d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.718809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73091ec-44e0-41f6-8c4e-539bdeb5c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.719472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73091ec-44e0-41f6-8c4e-539bdeb5c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.719775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73091ec-44e0-41f6-8c4e-539bdeb5c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.720175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73091ec-44e0-41f6-8c4e-539bdeb5c1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.721613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73091ec-44e0-41f6-8c4e-539bdeb5c1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.723190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73091ec-44e0-41f6-8c4e-539bdeb5c1e3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.732622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1206/2382] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:28:04 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:28:04.737308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:04.747400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00281e55-3489-4e9f-ae00-ce57a1bdeb38 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:04.751973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:04.752836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.753118 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.753644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] PATH_INFO: `/v3/projects/0da817f1905a4f8683dd629b0e873b81/users/1abedbad7ae94421a46120b10a3a06a6/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.755586 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da817f1905a4f8683dd629b0e873b81, user_id=1abedbad7ae94421a46120b10a3a06a6, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:04.758251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:04.768127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1177/2383] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:28:04 2021] PUT /identity/v3/projects/0da817f1905a4f8683dd629b0e873b81/users/1abedbad7ae94421a46120b10a3a06a6/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:28:04.779004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:04.779296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:04.779579 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:04.806502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] MFA Rules not processed for user `1abedbad7ae94421a46120b10a3a06a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:28:04.807716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:04.872987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1207/2384] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:28:04 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:28:55.154397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:55.156168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:55.209944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d2f75-dc8f-4234-a4c8-d35da0f4e94f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:55.213471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:55.214100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:55.214377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:55.214650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:55.216836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:55.283332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:55.285376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:55.295854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1178/2385] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:28:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:28:56.885878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:56.887219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:56.944162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b77fb-4433-406e-9d3e-10bf63d4e3e4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:56.947603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:56.948260 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:56.948545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:56.948831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:56.950564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:56.964803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:56.966218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:56.977177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1208/2386] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:28:56 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:28:57.039456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:57.048564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668bfbd-4c41-4867-a97b-3c0613169f5d service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:57.052362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:57.053004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:57.053290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:57.053569 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:57.055310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:57.122384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:57.123769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:57.133241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1179/2387] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:28:57 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:28:57.172774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:57.180948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55470f-1640-4d46-b199-aa6a194934a4 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:57.184497 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:57.185126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:57.185411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:57.185688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:57.187563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:28:57.244653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:57.246085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:57.255443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1209/2388] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:28:57 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:28:57.473765 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:28:57.482109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc66eb-f405-42a9-bbf7-a3a45d136b0b service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:28:57.486038 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:28:57.486666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:28:57.486968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:28:57.487223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:28:57.497313 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:28:57.498749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:28:57.511456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1180/2389] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:28:57 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:29:57.633523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:29:57.634907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:29:57.646118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd240b9-4583-4ed1-a2ca-e9abc44e53e1 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:29:57.649692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:29:57.650321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:29:57.650601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:29:57.650875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:29:57.652557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:29:57.734067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:29:57.735480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f3216-a30e-4680-908a-1faac42cb6c2 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:29:57.754207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1210/2390] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:29:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:29:59.992001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:00.003097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd08d6f-423c-4ad6-8331-debbece9dedd service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:00.008573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:00.009699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:00.010160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:00.011200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] PATH_INFO: `/v3/users/b6894097b4c24be3b57e88c3cfbe51cb` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:00.012755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6894097b4c24be3b57e88c3cfbe51cb)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:00.014917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:00.090694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6894097b4c24be3b57e88c3cfbe51cb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.101462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6894097b4c24be3b57e88c3cfbe51cb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.101462 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6894097b4c24be3b57e88c3cfbe51cb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.114751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6894097b4c24be3b57e88c3cfbe51cb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.121776 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6894097b4c24be3b57e88c3cfbe51cb'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.128567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1181/2391] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:29:59 2021] DELETE /identity/v3/users/b6894097b4c24be3b57e88c3cfbe51cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:00.133201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:00.133686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:00.133802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:00.159371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:00.161154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:00.217421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1211/2392] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:30:00.227816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:00.229199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:00.292053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f0491-1e44-47cd-9592-57612af25306 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:00.295691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:00.296336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:00.296619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:00.296894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:00.305890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:00.307659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:00.317241 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1182/2393] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:30:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:30:00.611923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:00.613806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:00.628074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173de93-c965-4e47-b1e2-97212e734cf7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:00.632940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:00.633815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:00.634093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:00.634370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] PATH_INFO: `/v3/projects/e4b4a0b493294a289a62943ddf493b39` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:00.636342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b4a0b493294a289a62943ddf493b39)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:00.638272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:00.685711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b4a0b493294a289a62943ddf493b39', 'request_id': 'req-4d69c378-fe47-4ff4-98b2-1468558bd755'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.693575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b4a0b493294a289a62943ddf493b39', 'request_id': 'req-4d69c378-fe47-4ff4-98b2-1468558bd755'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.699779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b4a0b493294a289a62943ddf493b39', 'request_id': 'req-4d69c378-fe47-4ff4-98b2-1468558bd755'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.710847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] The token cache is being invalidate because project e4b4a0b493294a289a62943ddf493b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:30:00.711111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.711726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.715209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1212/2394] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:30:00 2021] DELETE /identity/v3/projects/e4b4a0b493294a289a62943ddf493b39 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:00.717321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:00.726934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f4a28-8a49-4ce3-a4c6-6b29cda9ef01 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:00.781668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:00.783392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:00.785327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:00.786235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:00.786598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:00.786899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] PATH_INFO: `/v3/users/1abedbad7ae94421a46120b10a3a06a6` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:00.788808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1abedbad7ae94421a46120b10a3a06a6)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:00.791934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:00.798988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69c378-fe47-4ff4-98b2-1468558bd755 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:00.803775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:00.804653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:00.804946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:00.805231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] PATH_INFO: `/v3/users/d77e7d6b09ac482f8bf1bcf4c83ed05e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:00.806460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77e7d6b09ac482f8bf1bcf4c83ed05e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:00.808573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:00.845972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1abedbad7ae94421a46120b10a3a06a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.855258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1abedbad7ae94421a46120b10a3a06a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.856291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1abedbad7ae94421a46120b10a3a06a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.865365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77e7d6b09ac482f8bf1bcf4c83ed05e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.870140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1abedbad7ae94421a46120b10a3a06a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.877517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1abedbad7ae94421a46120b10a3a06a6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.877753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77e7d6b09ac482f8bf1bcf4c83ed05e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.878454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77e7d6b09ac482f8bf1bcf4c83ed05e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.879104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77e7d6b09ac482f8bf1bcf4c83ed05e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.884375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1183/2395] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:30:00 2021] DELETE /identity/v3/users/1abedbad7ae94421a46120b10a3a06a6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:00.887741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77e7d6b09ac482f8bf1bcf4c83ed05e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:00.903926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1213/2396] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:30:00 2021] DELETE /identity/v3/users/d77e7d6b09ac482f8bf1bcf4c83ed05e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:01.159436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.161459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.240975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f4711-6d0f-4bef-9bc2-95f78e033c42 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.248516 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.249943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.304711 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.305547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.305986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.306273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] PATH_INFO: `/v3/projects/03305e25979a4de2b9bf721e0ac9fabe` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.308056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03305e25979a4de2b9bf721e0ac9fabe)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.309955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.339556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50290a92-de7c-42a0-975f-0544ecf1645d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.345731 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.346624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.346892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.347179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] PATH_INFO: `/v3/projects/0da817f1905a4f8683dd629b0e873b81` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.349001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da817f1905a4f8683dd629b0e873b81)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.350919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.360761 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03305e25979a4de2b9bf721e0ac9fabe', 'request_id': 'req-7924ae3a-af53-4ec0-acd4-4454f01745c6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.367067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03305e25979a4de2b9bf721e0ac9fabe', 'request_id': 'req-7924ae3a-af53-4ec0-acd4-4454f01745c6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.375533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03305e25979a4de2b9bf721e0ac9fabe', 'request_id': 'req-7924ae3a-af53-4ec0-acd4-4454f01745c6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.387290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] The token cache is being invalidate because project 03305e25979a4de2b9bf721e0ac9fabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:30:01.387573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.388446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7924ae3a-af53-4ec0-acd4-4454f01745c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.395791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1184/2397] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:30:01 2021] DELETE /identity/v3/projects/03305e25979a4de2b9bf721e0ac9fabe => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:01.397596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebfed6-ad50-4415-a2a2-3fbe586877a5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.398258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebfed6-ad50-4415-a2a2-3fbe586877a5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.398968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebfed6-ad50-4415-a2a2-3fbe586877a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.407264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da817f1905a4f8683dd629b0e873b81', 'request_id': 'req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.416230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da817f1905a4f8683dd629b0e873b81', 'request_id': 'req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.423087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da817f1905a4f8683dd629b0e873b81', 'request_id': 'req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.435002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] The token cache is being invalidate because project 0da817f1905a4f8683dd629b0e873b81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:30:01.435290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.436065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-41cd096f-cf6d-4dcf-8798-9a73840d4c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:01.439741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1214/2398] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:30:01 2021] DELETE /identity/v3/projects/0da817f1905a4f8683dd629b0e873b81 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:01.444044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4081f-f5be-49c8-ad94-29f92ab2cb7e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.444318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4081f-f5be-49c8-ad94-29f92ab2cb7e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.444804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4081f-f5be-49c8-ad94-29f92ab2cb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.454374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c2ebfed6-ad50-4415-a2a2-3fbe586877a5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:01.455578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c2ebfed6-ad50-4415-a2a2-3fbe586877a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.465272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3fc4081f-f5be-49c8-ad94-29f92ab2cb7e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:01.466458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3fc4081f-f5be-49c8-ad94-29f92ab2cb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.523299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1185/2399] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:30:01.529881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1215/2400] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:01.531097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.531453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.531824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.537809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.538199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.538535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.551451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:01.552808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.560598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:01.561026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1186/2401] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:01.564385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.565384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.572394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1216/2402] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:01.575891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060e35a7-98ef-4c8b-998e-201a620492b5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.576633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.580861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.581692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.582671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.582962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.583802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:30:01.584120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.585754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.587780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2c6ab-e68c-4306-b28d-74ff041013f7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.593090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.593757 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.594163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.594450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.595201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:30:01.595794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.597316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.599260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1187/2403] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:30:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:30:01.603559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.611660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1217/2404] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:30:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:30:01.613040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1de2c-391e-4473-96be-85ca956f549c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.613562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.617697 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.618386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.618670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.618944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.619666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.621785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.622958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b69f5f-cc3d-4b15-b048-beb3a41b5394 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.627973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.628552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.629383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.629667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.630369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.632302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.657096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1188/2405] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:30:01.661188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.671576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1218/2406] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:30:01.675806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.721481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b958993-7579-4c0a-bacd-3e5b05e7aa83 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.735537 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38196-1aa7-465b-a8af-b67a7030631c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.740882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.742217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.742548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.742837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.743560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.747553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.770184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1219/2407] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:30:01.771232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.780548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e664fce-bb54-4f31-b991-c31a212dfe5b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.781773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.782713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.782999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.783276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.784091 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.785295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.785939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.786133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.786251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.786498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.787239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.788850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.798688 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1220/2408] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:01 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:30:01.803089 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.812718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1189/2409] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:30:01.813667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.817191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a2d52-7fe3-4075-bc84-6b0a2317a7f3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.821905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.822562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.822851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.823135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.823598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ae0c-db96-4ad1-b031-7c0668c3fbf5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.824040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.825641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.828234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.828874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.829160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.829440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.830200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.831867 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.835914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1221/2410] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:01 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:30:01.839880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.845183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1190/2411] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:30:01.848838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.849502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea742d50-3b7f-41c7-9eb8-ff4d99e35f9a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.854179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a622d-fec7-40ac-9ef4-8afc51f68f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.855037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a622d-fec7-40ac-9ef4-8afc51f68f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.855327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a622d-fec7-40ac-9ef4-8afc51f68f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.855608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a622d-fec7-40ac-9ef4-8afc51f68f2b admin admin] PATH_INFO: `/v3/projects/4d294ec3dd2b47e294a110c7edc99136/users/078498a621d44da29b934c7c27a80def/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.858382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb3557-02ff-4caa-ba45-8ec60c839553 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.862835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.864076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.864357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.864638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.865362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.866926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.870804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a622d-fec7-40ac-9ef4-8afc51f68f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d294ec3dd2b47e294a110c7edc99136, user_id=078498a621d44da29b934c7c27a80def, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.873617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a622d-fec7-40ac-9ef4-8afc51f68f2b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.876942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1191/2412] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:01 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:30:01.881584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:01.887677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1222/2413] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:30:01 2021] PUT /identity/v3/projects/4d294ec3dd2b47e294a110c7edc99136/users/078498a621d44da29b934c7c27a80def/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:01.891493 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767e67e-1180-49ec-bbd7-21d72494926e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:01.897389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.897728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.898025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.923105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] MFA Rules not processed for user `078498a621d44da29b934c7c27a80def`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:01.924367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:01.947086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f718c1-01fa-4bda-b2b8-fef4e4986784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:01.948014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f718c1-01fa-4bda-b2b8-fef4e4986784 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.948296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f718c1-01fa-4bda-b2b8-fef4e4986784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.948573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f718c1-01fa-4bda-b2b8-fef4e4986784 admin admin] PATH_INFO: `/v3/projects/4140c723ba694ed0acbdf0f0bfd9817b/users/365218c87e194c4d868131395f829e40/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.962356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f718c1-01fa-4bda-b2b8-fef4e4986784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4140c723ba694ed0acbdf0f0bfd9817b, user_id=365218c87e194c4d868131395f829e40, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:01.965025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f718c1-01fa-4bda-b2b8-fef4e4986784 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:01.978324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1192/2414] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:30:01 2021] PUT /identity/v3/projects/4140c723ba694ed0acbdf0f0bfd9817b/users/365218c87e194c4d868131395f829e40/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:01.987013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1223/2415] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:01.988835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:01.989114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:01.989395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:01.991443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.001560 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4bd22-2373-42e9-ad37-ec2b19537ac3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.015653 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] MFA Rules not processed for user `365218c87e194c4d868131395f829e40`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:02.017151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:02.057352 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.058057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.059685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.059980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.060703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.063344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.081022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1193/2416] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:02.095433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.098620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1224/2417] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:30:01 2021] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:30:02.098777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:02.099521 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.159200 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1ac35-639a-43b9-b173-1961350eb70c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.164324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.165018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.165308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.165590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.166290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.168251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.170558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da97eba-3e1b-422e-bb96-a4db4a523fd5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.188342 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1225/2418] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:30:02 2021] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:30:02.192201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.201591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952a26c-340b-4527-8551-8e32b29bdd34 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.206190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.206865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.207192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.207475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.208247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.209855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.223384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1226/2419] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:02 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:30:02.224578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.233511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.233837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111ba2-8622-4340-b904-2c897a02c689 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.234164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.234454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.234734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.239107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.240010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.240390 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.240670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] PATH_INFO: `/v3/projects/70a930d0a3ec4426b0dc8550e7cf25a5/users/e3d6c72005fd435abc8911e3164f3617/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.255485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a930d0a3ec4426b0dc8550e7cf25a5, user_id=e3d6c72005fd435abc8911e3164f3617, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.258117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.270930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1227/2420] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:30:02 2021] PUT /identity/v3/projects/70a930d0a3ec4426b0dc8550e7cf25a5/users/e3d6c72005fd435abc8911e3164f3617/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:02.274718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.289581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.291165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.300423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1194/2421] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:30:02 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:30:02.341124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fc5e7-dafb-46c8-998a-93c620e3cc85 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.345873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797ef04-816b-44b6-bb89-87607f916564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.346565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797ef04-816b-44b6-bb89-87607f916564 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.346848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797ef04-816b-44b6-bb89-87607f916564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.347133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797ef04-816b-44b6-bb89-87607f916564 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.348429 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797ef04-816b-44b6-bb89-87607f916564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.349993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797ef04-816b-44b6-bb89-87607f916564 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.359649 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1228/2422] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:02 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:30:02.364434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:02.374382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad63b0-184c-44d2-bd82-8067d104f493 service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:02.379145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:02.380043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.380326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.380601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] PATH_INFO: `/v3/projects/70a930d0a3ec4426b0dc8550e7cf25a5/users/e3d6c72005fd435abc8911e3164f3617/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.382545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a930d0a3ec4426b0dc8550e7cf25a5, user_id=e3d6c72005fd435abc8911e3164f3617, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:02.385185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:02.395530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1195/2423] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:30:02 2021] PUT /identity/v3/projects/70a930d0a3ec4426b0dc8550e7cf25a5/users/e3d6c72005fd435abc8911e3164f3617/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:02.410955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:02.411247 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:02.411598 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:02.437890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] MFA Rules not processed for user `e3d6c72005fd435abc8911e3164f3617`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:02.439070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:02.503448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1229/2424] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:02 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:30:57.675250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:57.676975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:57.754821 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6778d1-76a4-4f19-b364-d02a30cd4572 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:57.758419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:57.759059 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:57.759347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:57.759651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:57.787723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:57.789162 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:57.798330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1196/2425] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:30:57 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:30:57.863204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:57.875249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6749b-84cd-4a28-a34e-6159a0491e88 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:57.879034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339d7b0-21c7-4182-b9d9-73713a74955b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:57.879728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339d7b0-21c7-4182-b9d9-73713a74955b service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:57.880069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339d7b0-21c7-4182-b9d9-73713a74955b service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:57.880347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339d7b0-21c7-4182-b9d9-73713a74955b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:57.938674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339d7b0-21c7-4182-b9d9-73713a74955b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:57.940189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339d7b0-21c7-4182-b9d9-73713a74955b service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:57.950269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1230/2426] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:30:57 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:30:58.203900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:58.294794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd64889-eb53-4380-9f92-1bb113dff132 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:58.299200 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:58.300359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.300783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.301167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] PATH_INFO: `/v3/users/365218c87e194c4d868131395f829e40` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.302550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=365218c87e194c4d868131395f829e40)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:58.304768 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:58.358681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365218c87e194c4d868131395f829e40'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.369067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365218c87e194c4d868131395f829e40'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.370021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365218c87e194c4d868131395f829e40'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.384350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365218c87e194c4d868131395f829e40'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.391174 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365218c87e194c4d868131395f829e40'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.397957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1197/2427] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:30:58 2021] DELETE /identity/v3/users/365218c87e194c4d868131395f829e40 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:58.402751 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.403049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.403336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.420771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:58.421976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:58.425509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:58.426881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:58.480954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1231/2428] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:30:58.490752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:58.491373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d0b68-72da-4605-82d7-2cc938e3be8e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:58.492122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:58.496110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:58.496986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.497278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.497561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] PATH_INFO: `/v3/users/bf4bfb41207e48faaf73df96ae5d7445` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.498781 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4bfb41207e48faaf73df96ae5d7445)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:58.501044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:58.548337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4bfb41207e48faaf73df96ae5d7445'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.548588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b726aff-bfb1-425f-84aa-be3d9a4b3311 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:58.555730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4bfb41207e48faaf73df96ae5d7445'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.556400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4bfb41207e48faaf73df96ae5d7445'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.558909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:58.559575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.559895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.560171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.569375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4bfb41207e48faaf73df96ae5d7445'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.572563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:58.574019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:58.576224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d5e449c-da1e-4bc5-ab01-9b1b252dcea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4bfb41207e48faaf73df96ae5d7445'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:58.582060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1198/2429] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:30:58 2021] DELETE /identity/v3/users/bf4bfb41207e48faaf73df96ae5d7445 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:58.584219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1232/2430] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:30:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:30:58.589155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.589367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.589650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.606470 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:58.607718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:58.672077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1199/2431] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:30:58.683700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:58.685538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:58.698349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e9045-d3dc-4db3-a943-7aab830e5244 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:58.751523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20559d1-90ab-4658-9dad-d053b49fc6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:58.752266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20559d1-90ab-4658-9dad-d053b49fc6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.752857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20559d1-90ab-4658-9dad-d053b49fc6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.753155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20559d1-90ab-4658-9dad-d053b49fc6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.764559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20559d1-90ab-4658-9dad-d053b49fc6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:58.766024 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20559d1-90ab-4658-9dad-d053b49fc6f7 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:58.775713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1233/2432] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:30:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:30:58.944877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:58.946336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:58.958163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9848fe-2382-4d3d-82fa-3eee65ef962a None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:58.963686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:58.964542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:58.964831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:58.965106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] PATH_INFO: `/v3/projects/4140c723ba694ed0acbdf0f0bfd9817b` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:58.966333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4140c723ba694ed0acbdf0f0bfd9817b)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:58.968274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.025083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4140c723ba694ed0acbdf0f0bfd9817b', 'request_id': 'req-fa53d303-c91d-4953-a406-429495fc5870'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.031064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4140c723ba694ed0acbdf0f0bfd9817b', 'request_id': 'req-fa53d303-c91d-4953-a406-429495fc5870'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.038648 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4140c723ba694ed0acbdf0f0bfd9817b', 'request_id': 'req-fa53d303-c91d-4953-a406-429495fc5870'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.048596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] The token cache is being invalidate because project 4140c723ba694ed0acbdf0f0bfd9817b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:30:59.048883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.049509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.051026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1200/2433] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:30:58 2021] DELETE /identity/v3/projects/4140c723ba694ed0acbdf0f0bfd9817b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:30:59.057191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac784b9-a697-4445-92fe-9d86ffa8dce5 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.057690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac784b9-a697-4445-92fe-9d86ffa8dce5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.057799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac784b9-a697-4445-92fe-9d86ffa8dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.075759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9ac784b9-a697-4445-92fe-9d86ffa8dce5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:59.076966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9ac784b9-a697-4445-92fe-9d86ffa8dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.108763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.110467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.143158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1234/2434] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:59.151189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.151488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.151804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.170469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:59.171701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.179774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53d303-c91d-4953-a406-429495fc5870 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.180287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1235/2435] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:59.184309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.184551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.185596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.185883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.186192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] PATH_INFO: `/v3/projects/d58b1086f033402baa54d7f22d417af4` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.187401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d58b1086f033402baa54d7f22d417af4)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.189359 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.192968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f183c8b-2a44-49f1-ae46-b8da75760e6d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.197545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.198182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.198469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.198749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.199485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:30:59.199823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.201405 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.212527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1236/2436] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:30:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:30:59.216697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.227293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c8a01-12ae-426d-97c9-23f8f7d537e3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.239363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd58b1086f033402baa54d7f22d417af4', 'request_id': 'req-ed16af01-40cf-40c2-9f2e-eee94342f6c6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.246130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd58b1086f033402baa54d7f22d417af4', 'request_id': 'req-ed16af01-40cf-40c2-9f2e-eee94342f6c6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.254602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd58b1086f033402baa54d7f22d417af4', 'request_id': 'req-ed16af01-40cf-40c2-9f2e-eee94342f6c6'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.266058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] The token cache is being invalidate because project d58b1086f033402baa54d7f22d417af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:30:59.266472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.267243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.271647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1201/2437] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:30:59 2021] DELETE /identity/v3/projects/d58b1086f033402baa54d7f22d417af4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:59.273565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.275557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.289311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.289989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.290307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.290610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.291310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.293316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.323744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1237/2438] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:30:59.325011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.326595 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.346393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16af01-40cf-40c2-9f2e-eee94342f6c6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.397500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db2d91-c87a-4add-b275-829b594d5766 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.402733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.403664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.403841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.404124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.404877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.406799 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.408475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.409451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.409775 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.410052 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] PATH_INFO: `/v3/users/73f062931965438390e42a68021032ac` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.411377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f062931965438390e42a68021032ac)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.413522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.429623 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1238/2439] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:30:59.434205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.447431 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db07ca-dbf4-4590-9526-4ac40384a0bf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.454616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.455322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.455612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.455931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.456835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.458296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.472004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1239/2440] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:59 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:30:59.472310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f062931965438390e42a68021032ac'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.473347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.476942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f062931965438390e42a68021032ac'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.477750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f062931965438390e42a68021032ac'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.483582 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585698c7-714a-43e2-af12-c013249298d9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.490515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f062931965438390e42a68021032ac'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.491110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b759a-547c-414e-8f01-9c61f7330e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.491808 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b759a-547c-414e-8f01-9c61f7330e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.492090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b759a-547c-414e-8f01-9c61f7330e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.492365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b759a-547c-414e-8f01-9c61f7330e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.493110 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b759a-547c-414e-8f01-9c61f7330e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.494690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b759a-547c-414e-8f01-9c61f7330e2c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.497429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f062931965438390e42a68021032ac'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.503791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1202/2441] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:30:59 2021] DELETE /identity/v3/users/73f062931965438390e42a68021032ac => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:59.507882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1240/2442] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:30:59 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:30:59.511707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.513334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.581811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75c64-5c67-4db4-a3d1-7f91fc851da6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.586901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.587834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.588123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.588403 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] PATH_INFO: `/v3/projects/abb1cbb8c51d43188fff33d34633e930/users/a218e0e0ea064ed68c741bd64144f095/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.602649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb1cbb8c51d43188fff33d34633e930, user_id=a218e0e0ea064ed68c741bd64144f095, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.605669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.620439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1203/2443] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:30:59 2021] PUT /identity/v3/projects/abb1cbb8c51d43188fff33d34633e930/users/a218e0e0ea064ed68c741bd64144f095/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:59.632617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.632913 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.633198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.667423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] MFA Rules not processed for user `a218e0e0ea064ed68c741bd64144f095`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:59.671163 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.762766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1241/2444] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:30:59.767070 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.826218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.827515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.833452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed8f2-35ee-414e-ae17-cb565b22fa72 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.838078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.839063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.839063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.839388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.840020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.841935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.851526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f45fad-884a-4296-9c87-a7f577d9048e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.860892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.861786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.862073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.862421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] PATH_INFO: `/v3/projects/d300a7d7b29746f1b84b9283b087738a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.864183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d300a7d7b29746f1b84b9283b087738a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.866812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:30:59.873760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1204/2445] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:30:59.877896 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:30:59.914070 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd300a7d7b29746f1b84b9283b087738a', 'request_id': 'req-a390151e-d300-4dc2-8247-ab2b1d5aee5f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.921295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd300a7d7b29746f1b84b9283b087738a', 'request_id': 'req-a390151e-d300-4dc2-8247-ab2b1d5aee5f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.928033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd300a7d7b29746f1b84b9283b087738a', 'request_id': 'req-a390151e-d300-4dc2-8247-ab2b1d5aee5f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.938164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] The token cache is being invalidate because project d300a7d7b29746f1b84b9283b087738a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:30:59.938458 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.939097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a390151e-d300-4dc2-8247-ab2b1d5aee5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:30:59.939250 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0e775-77a2-4950-acac-ab64ca38f262 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:30:59.940883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1242/2446] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:30:59 2021] DELETE /identity/v3/projects/d300a7d7b29746f1b84b9283b087738a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:30:59.946321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c573a33-65c4-4fbf-a31a-7a15d066d32f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.946614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c573a33-65c4-4fbf-a31a-7a15d066d32f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.946892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c573a33-65c4-4fbf-a31a-7a15d066d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.964283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-1c573a33-65c4-4fbf-a31a-7a15d066d32f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:30:59.965650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1c573a33-65c4-4fbf-a31a-7a15d066d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:30:59.994273 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:30:59.994951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:30:59.995245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:30:59.995527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:30:59.996267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:30:59.998191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.017925 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1205/2447] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/users => generated 299 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:00.021763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.023439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1243/2448] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:30:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:00.023587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.030703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.031001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.031285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.034994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89726253-0295-45f9-b460-0006e2faab0f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.040156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.040808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.041096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.041389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.042120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.043729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.049155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:00.050505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.054351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1206/2449] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:00.058039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.063448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1244/2450] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:00.067531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.069001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c5c44-962b-4f08-97f7-9e708e741c21 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.073812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.074820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.075212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.075637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] PATH_INFO: `/v3/projects/94b3fe8b5dd94e29afacfd8edb12b04a/users/574bb7e586b94833a0650f974b455a75/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.076379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc36dee-279d-4dc6-900a-1a50483eeb8f None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.080936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.081576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.081861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.082137 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.082873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:00.083180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.084797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.090445 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b3fe8b5dd94e29afacfd8edb12b04a, user_id=574bb7e586b94833a0650f974b455a75, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.093182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.095852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1245/2451] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:31:00.100959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.108475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1207/2452] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:00 2021] PUT /identity/v3/projects/94b3fe8b5dd94e29afacfd8edb12b04a/users/574bb7e586b94833a0650f974b455a75/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:00.111884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.113037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7578f-8369-4412-b3bd-25c071b926a6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.171280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51890f1f-854f-42f1-ae0a-70a7f9ce6753 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.173280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.173940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.174226 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.174503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.175207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.176301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.177597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.177747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.177915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.178193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.178931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.180616 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.190338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1208/2453] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:00.194581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.204553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f905c01-27cb-4e34-b49e-feb625b4bd75 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.205690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1246/2454] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:00.210543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.260247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52e1e5-0e7e-41e8-91f9-c7e74c0ddafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.261133 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52e1e5-0e7e-41e8-91f9-c7e74c0ddafb admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.261413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52e1e5-0e7e-41e8-91f9-c7e74c0ddafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.261692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52e1e5-0e7e-41e8-91f9-c7e74c0ddafb admin admin] PATH_INFO: `/v3/projects/94b3fe8b5dd94e29afacfd8edb12b04a/users/574bb7e586b94833a0650f974b455a75/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.263708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52e1e5-0e7e-41e8-91f9-c7e74c0ddafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b3fe8b5dd94e29afacfd8edb12b04a, user_id=574bb7e586b94833a0650f974b455a75, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.266372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52e1e5-0e7e-41e8-91f9-c7e74c0ddafb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.269754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7ea4-4b8a-4ac4-a240-86afc8bb2e12 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.274502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.275274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.275557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.275877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.276674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1209/2455] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:00 2021] PUT /identity/v3/projects/94b3fe8b5dd94e29afacfd8edb12b04a/users/574bb7e586b94833a0650f974b455a75/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:00.276846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.278677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.286371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.286841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.287342 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.301502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1247/2456] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:00.303006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.312256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb987c5-6109-4e47-acd6-3ca847a4d89b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.316109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] MFA Rules not processed for user `574bb7e586b94833a0650f974b455a75`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:00.318833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.366117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.366709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.366998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.367280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.368097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.369817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.379778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1248/2457] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:00.384363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.387096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1210/2458] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:00.397276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.398767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.399322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0c066-e21a-4e65-8dd2-293b1ea55520 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.411538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.412437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.413767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.413767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.414074 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.415419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.425999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1249/2459] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:00.430512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.440306 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d67e6-574e-4daf-beb6-ea63fb742534 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.445485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6e3f8-f8c6-475e-acc1-652e627fba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.446355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e3f8-f8c6-475e-acc1-652e627fba10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.446639 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e3f8-f8c6-475e-acc1-652e627fba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.446921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6e3f8-f8c6-475e-acc1-652e627fba10 admin admin] PATH_INFO: `/v3/projects/9a36ab34524843298ebfd0e5e30557cc/users/52cdef746c4b4704aacf1706babfaa4b/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.460021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9039bc5-0d14-450e-8f8d-8798bd7b9394 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.461046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e3f8-f8c6-475e-acc1-652e627fba10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a36ab34524843298ebfd0e5e30557cc, user_id=52cdef746c4b4704aacf1706babfaa4b, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.463695 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6e3f8-f8c6-475e-acc1-652e627fba10 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.463852 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.464514 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.464655 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.464951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.476532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1250/2460] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:00 2021] PUT /identity/v3/projects/9a36ab34524843298ebfd0e5e30557cc/users/52cdef746c4b4704aacf1706babfaa4b/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:00.476736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.478145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.487991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32271-27e2-404c-b202-528c400a874d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.488176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1211/2461] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:00.488351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32271-27e2-404c-b202-528c400a874d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.488643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e32271-27e2-404c-b202-528c400a874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.515829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.517356 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b9e32271-27e2-404c-b202-528c400a874d None None] MFA Rules not processed for user `52cdef746c4b4704aacf1706babfaa4b`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:00.518552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b9e32271-27e2-404c-b202-528c400a874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.526006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2dc29-b810-4d11-9743-c3afa3d1f925 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.581121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.581916 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1251/2462] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:00.582140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.582256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.582524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] PATH_INFO: `/v3/users/a218e0e0ea064ed68c741bd64144f095` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.583908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a218e0e0ea064ed68c741bd64144f095)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.585812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.586258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32271-27e2-404c-b202-528c400a874d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.596014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e32271-27e2-404c-b202-528c400a874d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.601058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.601690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.601971 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.602252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.602942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.604835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.631539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1252/2463] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:00.633663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a218e0e0ea064ed68c741bd64144f095'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:00.635432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.641044 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a218e0e0ea064ed68c741bd64144f095'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:00.641675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a218e0e0ea064ed68c741bd64144f095'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:00.653109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a218e0e0ea064ed68c741bd64144f095'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:00.659668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9488143f-6552-4ce0-a9b4-ff72fbffc0fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a218e0e0ea064ed68c741bd64144f095'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:00.666402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1212/2464] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:00 2021] DELETE /identity/v3/users/a218e0e0ea064ed68c741bd64144f095 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:00.670650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.670935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.671214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.688393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:00.689607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.696328 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda1afd-c1b4-4175-beb6-998ca9316b09 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.747865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1213/2465] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:00.755973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.756917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.757057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.757258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.757966 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.758086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.759384 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.759924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.795432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1253/2466] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:00.796534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.798410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:00.811730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25daed1e-c912-4431-9126-c93f15ae6ee9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.817099 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.818445 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.826738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.826738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.826738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.826738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.829008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd22d0b-7050-4d76-893b-d94fecb419fe None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.835658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1254/2467] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:00.836178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.836959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.837339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.837672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.841335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.847517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.849237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.852392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258737-2f04-46d1-b62f-e8de58cdff71 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.857892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849be8f-56b6-493c-bcd6-1f4790720818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.858552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849be8f-56b6-493c-bcd6-1f4790720818 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.858737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1214/2468] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:00.859127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849be8f-56b6-493c-bcd6-1f4790720818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.859413 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849be8f-56b6-493c-bcd6-1f4790720818 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.860195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849be8f-56b6-493c-bcd6-1f4790720818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.862022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849be8f-56b6-493c-bcd6-1f4790720818 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.877653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1255/2469] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:00 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:00.885041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:00.895547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3897e-817e-4583-97dc-a350aebe2674 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:00.901204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:00.902274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.902612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.903041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] PATH_INFO: `/v3/projects/d22198f6986e41ecabac66380c68dff2/users/8117405737fb45f2be081cfbc608280b/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.921512 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22198f6986e41ecabac66380c68dff2, user_id=8117405737fb45f2be081cfbc608280b, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:00.924601 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:00.942370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1215/2470] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:00 2021] PUT /identity/v3/projects/d22198f6986e41ecabac66380c68dff2/users/8117405737fb45f2be081cfbc608280b/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:00.953319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:00.953633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:00.953938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:00.987836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] MFA Rules not processed for user `8117405737fb45f2be081cfbc608280b`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:00.991063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.079337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1256/2471] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:00 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:01.083732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.155941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbb3d0-6d47-43a9-9f1f-2468e581fbda admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.163825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.163825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.163825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.163825 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.164351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.165018 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.166011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.166543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.182361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f65dd06-b249-408c-96c5-1d99ab81ab7a None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.188454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.189543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.190009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.190611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] PATH_INFO: `/v3/projects/abb1cbb8c51d43188fff33d34633e930` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.192382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb1cbb8c51d43188fff33d34633e930)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.195340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.197487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1216/2472] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:01 2021] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:01.201635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.252031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb1cbb8c51d43188fff33d34633e930', 'request_id': 'req-326a69b7-6a05-4f82-92b4-20f285929b0a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.261326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb1cbb8c51d43188fff33d34633e930', 'request_id': 'req-326a69b7-6a05-4f82-92b4-20f285929b0a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.268038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb1cbb8c51d43188fff33d34633e930', 'request_id': 'req-326a69b7-6a05-4f82-92b4-20f285929b0a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.281234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] The token cache is being invalidate because project abb1cbb8c51d43188fff33d34633e930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:01.281668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.282411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.283218 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77decaa2-abb4-40bb-8183-c1f8a98361ef admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.284276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1257/2473] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:01 2021] DELETE /identity/v3/projects/abb1cbb8c51d43188fff33d34633e930 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:01.288283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.289605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.350443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.351306 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.351700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.352061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.352998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.357668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.362128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a69b7-6a05-4f82-92b4-20f285929b0a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.368055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.369058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.369663 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.370020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] PATH_INFO: `/v3/users/574bb7e586b94833a0650f974b455a75` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.371512 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574bb7e586b94833a0650f974b455a75)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.373676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.381114 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1217/2474] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:01 2021] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:01.381985 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.383791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.395115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cd897-c71b-4dc4-9596-92a9e25ef73a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.400292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.401362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.401728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.402115 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] PATH_INFO: `/v3/users/078498a621d44da29b934c7c27a80def` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.403430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078498a621d44da29b934c7c27a80def)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.405584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.423133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574bb7e586b94833a0650f974b455a75'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.435942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574bb7e586b94833a0650f974b455a75'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.436665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574bb7e586b94833a0650f974b455a75'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.437453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574bb7e586b94833a0650f974b455a75'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.444183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574bb7e586b94833a0650f974b455a75'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.451327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078498a621d44da29b934c7c27a80def'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.456607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1258/2475] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:01 2021] DELETE /identity/v3/users/574bb7e586b94833a0650f974b455a75 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:01.458522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078498a621d44da29b934c7c27a80def'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.459299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078498a621d44da29b934c7c27a80def'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.460613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.461939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.472201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078498a621d44da29b934c7c27a80def'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.479967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-89bd1b14-8c9d-41e4-9f75-36be7ce6b9d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078498a621d44da29b934c7c27a80def'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.486665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1218/2476] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:01 2021] DELETE /identity/v3/users/078498a621d44da29b934c7c27a80def => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:01.492084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.492459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.492838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.511771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:01.513074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.538515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a038d-591e-411e-a3c7-5badcd97a332 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.585157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1219/2477] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:01.594883 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.596291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.604179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.604917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.605210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.605495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.606252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.607888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.632312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1259/2478] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:01 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:01.636298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.638785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.651349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4171468-9487-454a-81a3-a86e895ae9dc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.654625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c01da5-4c2f-461d-9ac8-a64a1b7ca295 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.656584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.657573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.658056 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.658373 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.658517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] PATH_INFO: `/v3/projects/fd53ca8ace1449e9abccd1fe452a62e1/users/72220f829c1b43bf9c14b15cfa8c8cb0/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.659017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.659472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.659779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.669651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.671076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.674963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd53ca8ace1449e9abccd1fe452a62e1, user_id=72220f829c1b43bf9c14b15cfa8c8cb0, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.678261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.682540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1220/2479] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:01.691282 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1260/2480] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:01 2021] PUT /identity/v3/projects/fd53ca8ace1449e9abccd1fe452a62e1/users/72220f829c1b43bf9c14b15cfa8c8cb0/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:01.695443 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.705025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6c556-bf57-4164-bc97-1a31badcf021 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.764252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.764963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.765222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.765552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.766279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.767949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.778516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1221/2481] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:01 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:01.785122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.787346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.787574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.797599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4cbbf-2093-45c3-b4a0-47caa1f33e9f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.801187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c1818-032c-471a-96e9-f4949a3184b0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:01.807126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.808126 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.808541 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adfaa68-2596-4891-aecf-b46dfc8de44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:01.808712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.809039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] PATH_INFO: `/v3/projects/94b3fe8b5dd94e29afacfd8edb12b04a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.809419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfaa68-2596-4891-aecf-b46dfc8de44a admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.809704 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfaa68-2596-4891-aecf-b46dfc8de44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.809984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adfaa68-2596-4891-aecf-b46dfc8de44a admin admin] PATH_INFO: `/v3/projects/fd53ca8ace1449e9abccd1fe452a62e1/users/72220f829c1b43bf9c14b15cfa8c8cb0/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.810659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b3fe8b5dd94e29afacfd8edb12b04a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.812577 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfaa68-2596-4891-aecf-b46dfc8de44a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd53ca8ace1449e9abccd1fe452a62e1, user_id=72220f829c1b43bf9c14b15cfa8c8cb0, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:01.812741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.815571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adfaa68-2596-4891-aecf-b46dfc8de44a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:01.841899 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1222/2482] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:01 2021] PUT /identity/v3/projects/fd53ca8ace1449e9abccd1fe452a62e1/users/72220f829c1b43bf9c14b15cfa8c8cb0/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:01.852600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.852971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.853159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.877142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b3fe8b5dd94e29afacfd8edb12b04a', 'request_id': 'req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.883874 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] MFA Rules not processed for user `72220f829c1b43bf9c14b15cfa8c8cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:01.885195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.889607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b3fe8b5dd94e29afacfd8edb12b04a', 'request_id': 'req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.898518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b3fe8b5dd94e29afacfd8edb12b04a', 'request_id': 'req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.920461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] The token cache is being invalidate because project 94b3fe8b5dd94e29afacfd8edb12b04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:01.923884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.925713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-dc5ae155-ad4e-4c5b-9896-d194762fe7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:01.929144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1261/2483] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:01 2021] DELETE /identity/v3/projects/94b3fe8b5dd94e29afacfd8edb12b04a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:01.936040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fb042-8465-43b2-a7e2-8fe451307ce1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:01.936338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fb042-8465-43b2-a7e2-8fe451307ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:01.936619 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fb042-8465-43b2-a7e2-8fe451307ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:01.959399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-8c2fb042-8465-43b2-a7e2-8fe451307ce1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:01.960652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8c2fb042-8465-43b2-a7e2-8fe451307ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:01.982271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1223/2484] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:01 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:01.993372 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:01.995014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.025151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1262/2485] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:02.033154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.033568 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.033851 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.055029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:02.055179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.063608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1263/2486] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:02.064184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1c741-dd6e-4443-aa30-2eec71fdecc7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.065007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.066594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.070493 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.071151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.071438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.071786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.073700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.079265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d63a8-2bfc-4a3b-9263-944241535d86 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.091396 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.092346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.092681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.092963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] PATH_INFO: `/v3/projects/4d294ec3dd2b47e294a110c7edc99136` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.094153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d294ec3dd2b47e294a110c7edc99136)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.096289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.133179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.134615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.142767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d294ec3dd2b47e294a110c7edc99136', 'request_id': 'req-fb48404c-a53f-4121-99ff-f2124ea9f3b9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.143433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1224/2487] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:01 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:02.144257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.152825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d294ec3dd2b47e294a110c7edc99136', 'request_id': 'req-fb48404c-a53f-4121-99ff-f2124ea9f3b9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.155047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ff3b-2d1d-4453-9285-890225146eb0 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.159590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d294ec3dd2b47e294a110c7edc99136', 'request_id': 'req-fb48404c-a53f-4121-99ff-f2124ea9f3b9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.169653 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] The token cache is being invalidate because project 4d294ec3dd2b47e294a110c7edc99136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:02.170005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.170601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.172175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1264/2488] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:02 2021] DELETE /identity/v3/projects/4d294ec3dd2b47e294a110c7edc99136 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:02.175918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.177221 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.214806 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.215474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.215877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.216054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.216790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:02.217098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.218672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.230841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1225/2489] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:31:02.235323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.237036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.245027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb48404c-a53f-4121-99ff-f2124ea9f3b9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.249161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07dc9-d691-45f7-9243-a0e417a7af2d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.249995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.250892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.251237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.251460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] PATH_INFO: `/v3/users/e3d6c72005fd435abc8911e3164f3617` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.252717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d6c72005fd435abc8911e3164f3617)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.254624 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.254767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.255890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.256177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.256456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.257161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.259031 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.292983 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1226/2490] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:02.297399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.309043 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d6c72005fd435abc8911e3164f3617'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.322575 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d6c72005fd435abc8911e3164f3617'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.323316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d6c72005fd435abc8911e3164f3617'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.323973 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d6c72005fd435abc8911e3164f3617'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.332091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d6c72005fd435abc8911e3164f3617'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.349173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1265/2491] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:02 2021] DELETE /identity/v3/users/e3d6c72005fd435abc8911e3164f3617 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:02.361989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b40d23-de31-4724-8228-b91abce8aac5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.429886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.430574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.430862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.431193 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.431949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.434037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.456853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1227/2492] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:02.461136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.462816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.477584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2287210-a9cc-4f80-9ffd-20fadbf3fda1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.482366 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.483041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.483327 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.483606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.484382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.485981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.497448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1266/2493] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:02 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:02.501872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.513554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f2f74-e8a1-4219-a77a-8ae758b0601e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.519060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b4f84-e3b5-425b-be4b-c2a5bff9adc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.519829 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b4f84-e3b5-425b-be4b-c2a5bff9adc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.520179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b4f84-e3b5-425b-be4b-c2a5bff9adc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.520492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b4f84-e3b5-425b-be4b-c2a5bff9adc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.521266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b4f84-e3b5-425b-be4b-c2a5bff9adc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.522876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b4f84-e3b5-425b-be4b-c2a5bff9adc6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.539644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.539837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1228/2494] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:02.550154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209d66f-11c0-4422-abeb-64ae6c5a49cf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.561401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.562295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.562577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.562853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] PATH_INFO: `/v3/projects/2d6b1c99122b4b9b82511feb80ea764e/users/b3e08687bd074fd8a1049605c21a053f/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.580234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6b1c99122b4b9b82511feb80ea764e, user_id=b3e08687bd074fd8a1049605c21a053f, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.583144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.596538 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1267/2495] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:02 2021] PUT /identity/v3/projects/2d6b1c99122b4b9b82511feb80ea764e/users/b3e08687bd074fd8a1049605c21a053f/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:02.607716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.607939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.608222 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.636154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] MFA Rules not processed for user `b3e08687bd074fd8a1049605c21a053f`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:02.637419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.652817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.654505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.704649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1229/2496] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:02.709206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.718894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c186cc6-0123-4bc6-b79f-5273ecb772fc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.719255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78008c-727a-41db-bcaa-b4e201904064 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.723433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.723981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.724329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.724615 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.724735 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.724888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] PATH_INFO: `/v3/projects/70a930d0a3ec4426b0dc8550e7cf25a5` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.725003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.725211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.725910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.726067 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a930d0a3ec4426b0dc8550e7cf25a5)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.727809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.727976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.753473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1230/2497] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:02.758249 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.776397 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a930d0a3ec4426b0dc8550e7cf25a5', 'request_id': 'req-1cb93c31-dbf5-43de-b336-30b7272b909b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.784073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a930d0a3ec4426b0dc8550e7cf25a5', 'request_id': 'req-1cb93c31-dbf5-43de-b336-30b7272b909b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.790601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a930d0a3ec4426b0dc8550e7cf25a5', 'request_id': 'req-1cb93c31-dbf5-43de-b336-30b7272b909b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.800667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] The token cache is being invalidate because project 70a930d0a3ec4426b0dc8550e7cf25a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:02.801082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.801747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1cb93c31-dbf5-43de-b336-30b7272b909b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:02.803841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1268/2498] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:02 2021] DELETE /identity/v3/projects/70a930d0a3ec4426b0dc8550e7cf25a5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:02.809474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948475b-326d-4998-b477-e70701ccef7d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.809794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948475b-326d-4998-b477-e70701ccef7d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.810078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948475b-326d-4998-b477-e70701ccef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.818217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130638-9955-4a31-9d54-d1586d8d300d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.828160 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0948475b-326d-4998-b477-e70701ccef7d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:02.829360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0948475b-326d-4998-b477-e70701ccef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.871459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.872154 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.872438 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.872712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.873420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.875573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.887072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1269/2499] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:02.894932 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.895362 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.896324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.898217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1231/2500] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/users => generated 307 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:02.901795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.903458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.916484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917ddae-0f77-4f7b-adf4-52f5ce4447a7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.918187 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:02.919387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:02.922063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.922792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.923140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.923520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.924550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.926195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.927926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1270/2501] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:02.932993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.939481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1232/2502] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:02.940417 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.942307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a889e1c-af1e-4b4e-90be-045ed4a36ea7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.947650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.948418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.948614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.949114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.949719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:02.949951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.950754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6397be-7391-411e-a9f3-46273ab15c79 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.951506 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.956669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.957745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.958054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.959280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] PATH_INFO: `/v3/projects/60296007a7ea455ab69410fc58f48af5/users/4d1c5dc26e954d4986fc161fc587ee46/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.964841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1271/2503] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:31:02.968997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:02.974754 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60296007a7ea455ab69410fc58f48af5, user_id=4d1c5dc26e954d4986fc161fc587ee46, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.977656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.979315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a69365-b45f-49aa-9269-a1577e8b35d9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:02.985547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:02.986303 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:02.986651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:02.987115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:02.987922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:02.989911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:02.991707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1233/2504] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:02 2021] PUT /identity/v3/projects/60296007a7ea455ab69410fc58f48af5/users/4d1c5dc26e954d4986fc161fc587ee46/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:02.995175 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.016441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1272/2505] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:02 2021] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:03.020492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.055517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747f1c1-a42e-43e8-8332-e12b135fb78e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.081901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995814a9-a57d-4d8e-90d5-4235697b9f5d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.087088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.087795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.088080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.088358 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.089232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.091143 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.110638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.111484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.111878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.112261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.113280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.113422 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1273/2506] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:03 2021] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:03.114969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.117534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.129480 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1234/2507] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:02 2021] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:03.129660 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c414-46d5-43af-956b-53424b59babb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.131130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.133021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.133678 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.133967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.134248 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.134992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.136605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.140755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a628-e7f4-4c74-8c27-fb08b4ac82d1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.145424 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51619c17-c837-4f25-aef0-82c8e8793ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.146839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51619c17-c837-4f25-aef0-82c8e8793ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.146997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1274/2508] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:03.147113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51619c17-c837-4f25-aef0-82c8e8793ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.147418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51619c17-c837-4f25-aef0-82c8e8793ad7 admin admin] PATH_INFO: `/v3/projects/60296007a7ea455ab69410fc58f48af5/users/4d1c5dc26e954d4986fc161fc587ee46/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.149387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51619c17-c837-4f25-aef0-82c8e8793ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60296007a7ea455ab69410fc58f48af5, user_id=4d1c5dc26e954d4986fc161fc587ee46, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.150904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.152049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51619c17-c837-4f25-aef0-82c8e8793ad7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.160029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399a12-1a76-4ed3-8fd4-98a51c4b7ea1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.162103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1235/2509] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:03 2021] PUT /identity/v3/projects/60296007a7ea455ab69410fc58f48af5/users/4d1c5dc26e954d4986fc161fc587ee46/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:03.171927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.172207 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.172609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.199277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] MFA Rules not processed for user `4d1c5dc26e954d4986fc161fc587ee46`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:03.200511 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:03.215469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.216164 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.216448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.216724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.217460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.219039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.229404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1275/2510] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:03 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:03.233600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.243645 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe364d57-c3b5-40e4-ab0c-c24ea2bdbfdd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.248436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850e7ba-4046-4099-ba6e-5f4c502445e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.249336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850e7ba-4046-4099-ba6e-5f4c502445e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.249882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850e7ba-4046-4099-ba6e-5f4c502445e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.250168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850e7ba-4046-4099-ba6e-5f4c502445e6 admin admin] PATH_INFO: `/v3/projects/2f877cf0d9fb451499ded0718450f1fa/users/82a2a91807cb455fa48462410b3818c7/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.264857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850e7ba-4046-4099-ba6e-5f4c502445e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f877cf0d9fb451499ded0718450f1fa, user_id=82a2a91807cb455fa48462410b3818c7, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.267566 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850e7ba-4046-4099-ba6e-5f4c502445e6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.268395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1236/2511] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:03 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:03.279013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.281143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:03.284409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1276/2512] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:03 2021] PUT /identity/v3/projects/2f877cf0d9fb451499ded0718450f1fa/users/82a2a91807cb455fa48462410b3818c7/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:03.305641 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.306108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.306574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.345083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] MFA Rules not processed for user `82a2a91807cb455fa48462410b3818c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:03.346949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:03.361872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446bdcf-e48e-4434-885b-eddcfc5c0f44 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.414263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1277/2513] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:03 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:03.415405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.416399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.416833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.417258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.418587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.477919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6f75b-ef17-4691-84ea-cde1c198a55d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.482461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.483115 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.483400 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.483707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.484416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.486305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.488572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.490515 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.500578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1237/2514] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:03 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:03.512402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1278/2515] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:03 2021] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:03.520893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.531876 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d937a34-23d3-4161-898b-c75e0bbb9dba service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.591679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.592354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.592643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.592931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.593644 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.595560 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.611053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.615667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1238/2516] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:03 2021] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:03.619326 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.628881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175415-eaec-4712-8ed2-555cfef54e7c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.633518 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.634166 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.634454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.634734 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.635473 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.637164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.649769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1239/2517] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:03.650972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.660263 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37f520-650c-4beb-8410-c3d970cb5618 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.665336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c589e6b-1bfc-48fd-877f-f157d7ac56ad admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.665490 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.666216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.666508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.666792 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] PATH_INFO: `/v3/projects/eaea05c9d05e4e4c96331ecd1447ff0c/users/c807d14226cc400f9ba1c6370d224167/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.669149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.669817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.670127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.670404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.672199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:03.683156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaea05c9d05e4e4c96331ecd1447ff0c, user_id=c807d14226cc400f9ba1c6370d224167, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.685940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.698265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1240/2518] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:03 2021] PUT /identity/v3/projects/eaea05c9d05e4e4c96331ecd1447ff0c/users/c807d14226cc400f9ba1c6370d224167/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:03.702497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.732801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.734179 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.744216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1279/2519] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:03 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:03.765423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9aebf-11b9-46e6-8814-e2a89a7c38fd admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.770382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb02bd5-5ff9-40b8-ae90-86477abb8728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.771058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02bd5-5ff9-40b8-ae90-86477abb8728 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.771348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02bd5-5ff9-40b8-ae90-86477abb8728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.771639 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb02bd5-5ff9-40b8-ae90-86477abb8728 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.772389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb02bd5-5ff9-40b8-ae90-86477abb8728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.773996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb02bd5-5ff9-40b8-ae90-86477abb8728 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.784011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1241/2520] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:03 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:03.789053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:03.799755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b52106-3b57-4644-98be-10a8f8623eff service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:03.804997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:03.805883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.806175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.806460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] PATH_INFO: `/v3/projects/eaea05c9d05e4e4c96331ecd1447ff0c/users/c807d14226cc400f9ba1c6370d224167/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.808481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaea05c9d05e4e4c96331ecd1447ff0c, user_id=c807d14226cc400f9ba1c6370d224167, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:03.811186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:03.821856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1280/2521] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:03 2021] PUT /identity/v3/projects/eaea05c9d05e4e4c96331ecd1447ff0c/users/c807d14226cc400f9ba1c6370d224167/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:03.831787 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:03.832082 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:03.832366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:03.861413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] MFA Rules not processed for user `c807d14226cc400f9ba1c6370d224167`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:03.862783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:03.936897 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1242/2522] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:03 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:04.016869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:04.075145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9b189-5914-4bab-9aa8-edd1adf3c0a6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:04.078876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:04.079529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:04.079875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:04.080158 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:04.089991 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:04.091420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:04.101195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1281/2523] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:04 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:04.237327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:04.248543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823470c-37c0-4da2-96ed-a5d5baa63ca5 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:04.252245 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:04.252877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:04.253157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:04.253432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:04.306216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:04.307660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:04.316192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1243/2524] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:04 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:08.635775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:08.637149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:08.729191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e696f-b530-4d07-a6b1-d31e1ab3ada7 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:08.734716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:08.735368 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:08.735682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:08.735969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:08.737743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:08.749720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:08.751355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:08.762332 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1282/2525] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:10.000138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:10.009392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32316cf8-d52f-4184-bd36-c7253ef1b51a service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:10.013071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:10.013723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:10.013988 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:10.014265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:10.016039 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:10.073210 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:10.074571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:10.083583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1244/2526] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:09 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:12.839717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:12.848656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d81ea7-ab07-4982-9c12-7e08132e7f02 service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:12.852182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:12.852819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:12.853135 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:12.853418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:12.855156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:12.915441 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:12.916915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346641e-e3ee-4ef3-bf32-b708ee81562f service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:12.926424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1283/2527] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:12 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:18.482558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:18.549261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e86858-3ad5-4428-b095-cb604b9589c5 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:18.554651 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:18.555540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:18.556453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:18.556748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] PATH_INFO: `/v3/users/b3e08687bd074fd8a1049605c21a053f` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:18.557987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3e08687bd074fd8a1049605c21a053f)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:18.559934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:18.611413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3e08687bd074fd8a1049605c21a053f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:18.620533 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3e08687bd074fd8a1049605c21a053f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:18.621252 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3e08687bd074fd8a1049605c21a053f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:18.636214 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3e08687bd074fd8a1049605c21a053f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:18.643276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3e08687bd074fd8a1049605c21a053f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:18.649491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1245/2528] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:18 2021] DELETE /identity/v3/users/b3e08687bd074fd8a1049605c21a053f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:18.653874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:18.654360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:18.654469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:18.671883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:18.673081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:18.731485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1284/2529] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:18.741690 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:18.744254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:18.805041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8191d3-f2db-4cca-9766-89411ba717ca admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:18.809364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:18.810011 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:18.810296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:18.810604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:18.819865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:18.821307 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:18.830703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1246/2530] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:19.138478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:19.140673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:19.165229 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc745671-403a-4527-beb6-175b1085c3a1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:19.173774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:19.174723 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.175036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.175377 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] PATH_INFO: `/v3/projects/2d6b1c99122b4b9b82511feb80ea764e` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.177174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6b1c99122b4b9b82511feb80ea764e)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:19.179274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:19.229905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6b1c99122b4b9b82511feb80ea764e', 'request_id': 'req-a714d397-8038-4ba7-ac26-99fc9d19f4ff'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.236561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6b1c99122b4b9b82511feb80ea764e', 'request_id': 'req-a714d397-8038-4ba7-ac26-99fc9d19f4ff'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.243166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6b1c99122b4b9b82511feb80ea764e', 'request_id': 'req-a714d397-8038-4ba7-ac26-99fc9d19f4ff'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.253839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] The token cache is being invalidate because project 2d6b1c99122b4b9b82511feb80ea764e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:19.254134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.254797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.258444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1285/2531] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:19 2021] DELETE /identity/v3/projects/2d6b1c99122b4b9b82511feb80ea764e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:19.261026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:19.270409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189aa79-f9f8-403f-a607-89adca43ccec service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:19.329251 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:19.330247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.330712 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.330991 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] PATH_INFO: `/v3/users/4d1c5dc26e954d4986fc161fc587ee46` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.332380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1c5dc26e954d4986fc161fc587ee46)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:19.334287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:19.389364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1c5dc26e954d4986fc161fc587ee46'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.398924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1c5dc26e954d4986fc161fc587ee46'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.400215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1c5dc26e954d4986fc161fc587ee46'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.412875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1c5dc26e954d4986fc161fc587ee46'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.422457 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3520df5e-7a83-41c1-b5cd-6ab5942e81ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1c5dc26e954d4986fc161fc587ee46'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.430282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1247/2532] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:19 2021] DELETE /identity/v3/users/4d1c5dc26e954d4986fc161fc587ee46 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:19.448337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:19.450127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:19.464425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714d397-8038-4ba7-ac26-99fc9d19f4ff admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:19.532542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:19.533884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.534349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.534633 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] PATH_INFO: `/v3/users/82a2a91807cb455fa48462410b3818c7` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.538370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a2a91807cb455fa48462410b3818c7)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:19.545272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:19.601491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a2a91807cb455fa48462410b3818c7'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.615079 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a2a91807cb455fa48462410b3818c7'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.616114 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a2a91807cb455fa48462410b3818c7'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.616794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a2a91807cb455fa48462410b3818c7'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.626052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a2a91807cb455fa48462410b3818c7'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.640732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1286/2533] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:19 2021] DELETE /identity/v3/users/82a2a91807cb455fa48462410b3818c7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:19.646120 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.646683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.646683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.669444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:19.671431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:19.751602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1248/2534] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:19.763612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:19.766504 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:19.771459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:19.773314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:19.806946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03bada2-3545-4fc6-9954-b402aed8a564 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:19.816681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:19.817870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.823183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.823527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] PATH_INFO: `/v3/projects/60296007a7ea455ab69410fc58f48af5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.826019 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60296007a7ea455ab69410fc58f48af5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:19.828325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:19.862416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c795a4-aa70-4b89-bb85-4cc742826636 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:19.873197 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814dc0a-7961-4e1a-bd6e-abf211ff89a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:19.875116 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814dc0a-7961-4e1a-bd6e-abf211ff89a6 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.875753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814dc0a-7961-4e1a-bd6e-abf211ff89a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.881533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814dc0a-7961-4e1a-bd6e-abf211ff89a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.890978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60296007a7ea455ab69410fc58f48af5', 'request_id': 'req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.899557 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814dc0a-7961-4e1a-bd6e-abf211ff89a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:19.901210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814dc0a-7961-4e1a-bd6e-abf211ff89a6 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:19.902830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60296007a7ea455ab69410fc58f48af5', 'request_id': 'req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.913539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1287/2535] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:19.925122 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60296007a7ea455ab69410fc58f48af5', 'request_id': 'req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.938836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] The token cache is being invalidate because project 60296007a7ea455ab69410fc58f48af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:19.939303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.940004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-ede4fcba-ba38-4d6c-9aa2-7c92127ff273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:19.942346 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1249/2536] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:19 2021] DELETE /identity/v3/projects/60296007a7ea455ab69410fc58f48af5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:19.949165 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:19.949738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:19.950186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:19.972022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:19.973406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.049447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1288/2537] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:20.059037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.059324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.059748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.081951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:20.083034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.097602 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.099718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1250/2538] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:20.108654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2faa9-44c5-4f9f-81a2-d97778eb54a6 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.113406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.114063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.114535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.114864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.115659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:20.115972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.117570 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.138075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1289/2539] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:31:20.138195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.143564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cf195-e40a-42df-9c65-5a8a02cf4c1e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.148984 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.149800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.150228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.150544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.151324 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.153323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.180090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1251/2540] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:20 2021] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:20.186481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.196315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519831d1-871b-4dcd-8bbc-92654c9ba4c2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.231348 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.233215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.263880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.264559 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.264889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.265173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.265883 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.267836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.291463 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1290/2541] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:20 2021] POST /identity/v3/users => generated 281 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:20.292556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.299877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bab041-7276-4d83-ba3e-7fe5c32ea5a8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.302503 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63323529-972d-44f9-ae44-c3b21c0525de admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.304623 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.305626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.306520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.306805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] PATH_INFO: `/v3/projects/2f877cf0d9fb451499ded0718450f1fa` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.307697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.308056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f877cf0d9fb451499ded0718450f1fa)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.308344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.308630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.308907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.309640 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.310001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.311265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.321039 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1291/2542] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:20.324930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.334130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579a427-4b95-450e-a495-0027dce8470e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.339768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.340418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.340708 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.340993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.341759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.343341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.354508 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1292/2543] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:20.356189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f877cf0d9fb451499ded0718450f1fa', 'request_id': 'req-7335fdcc-9cef-44a8-9e6d-1212bffe40df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.358324 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.362598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f877cf0d9fb451499ded0718450f1fa', 'request_id': 'req-7335fdcc-9cef-44a8-9e6d-1212bffe40df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.368021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a1cf-f0ef-4541-b98f-26df389b6933 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.371007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f877cf0d9fb451499ded0718450f1fa', 'request_id': 'req-7335fdcc-9cef-44a8-9e6d-1212bffe40df'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.381520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] The token cache is being invalidate because project 2f877cf0d9fb451499ded0718450f1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:20.381811 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.382532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.384137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1252/2544] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:20 2021] DELETE /identity/v3/projects/2f877cf0d9fb451499ded0718450f1fa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:20.387872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.389287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.424739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9111b-2728-4922-abc4-b54d0e8164d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.425626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9111b-2728-4922-abc4-b54d0e8164d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.425915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9111b-2728-4922-abc4-b54d0e8164d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.426191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9111b-2728-4922-abc4-b54d0e8164d1 admin admin] PATH_INFO: `/v3/projects/274c06f5ad1b40f4ac5b99b168dd3ad7/users/58c3c57f6b8842708b6ef36e73d75e01/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.441111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9111b-2728-4922-abc4-b54d0e8164d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274c06f5ad1b40f4ac5b99b168dd3ad7, user_id=58c3c57f6b8842708b6ef36e73d75e01, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.443831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9111b-2728-4922-abc4-b54d0e8164d1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.451152 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335fdcc-9cef-44a8-9e6d-1212bffe40df admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.456273 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1293/2545] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:20 2021] PUT /identity/v3/projects/274c06f5ad1b40f4ac5b99b168dd3ad7/users/58c3c57f6b8842708b6ef36e73d75e01/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:20.466389 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.466679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.466964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.493984 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] MFA Rules not processed for user `58c3c57f6b8842708b6ef36e73d75e01`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:20.495288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.506158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.507024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.507303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.507582 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] PATH_INFO: `/v3/users/c807d14226cc400f9ba1c6370d224167` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.508820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c807d14226cc400f9ba1c6370d224167)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.510771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.568354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c807d14226cc400f9ba1c6370d224167'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.578149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1294/2546] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:20 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:20.578893 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c807d14226cc400f9ba1c6370d224167'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.579770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c807d14226cc400f9ba1c6370d224167'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.595545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c807d14226cc400f9ba1c6370d224167'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.603656 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c807d14226cc400f9ba1c6370d224167'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.608564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.612983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.613096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1253/2547] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:20 2021] DELETE /identity/v3/users/c807d14226cc400f9ba1c6370d224167 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:20.669747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01cd2-bf19-49dd-8fc9-038935507fdc None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.719162 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.719881 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.720170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.720628 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.722444 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.787488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.789077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.798261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1295/2548] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:20 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:20.813545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.815121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.890708 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8da67-c3e7-44a3-bbe4-39ae0b570a21 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.895884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.896762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.897049 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.897328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] PATH_INFO: `/v3/users/58c3c57f6b8842708b6ef36e73d75e01` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.898550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c3c57f6b8842708b6ef36e73d75e01)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.901182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.905019 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:20.908243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:20.936094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b10f88-ad2c-46e0-ac0f-3c8fef5c3ad9 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:20.942793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:20.943927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:20.944323 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:20.944747 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] PATH_INFO: `/v3/projects/eaea05c9d05e4e4c96331ecd1447ff0c` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:20.955795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaea05c9d05e4e4c96331ecd1447ff0c)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:20.957961 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:20.972289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c3c57f6b8842708b6ef36e73d75e01'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.981236 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c3c57f6b8842708b6ef36e73d75e01'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.981885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c3c57f6b8842708b6ef36e73d75e01'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:20.995528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c3c57f6b8842708b6ef36e73d75e01'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.004467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-00a9a6c7-aea8-4bcf-980d-62058cc3e403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c3c57f6b8842708b6ef36e73d75e01'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.012449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1254/2549] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:20 2021] DELETE /identity/v3/users/58c3c57f6b8842708b6ef36e73d75e01 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:21.017225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.017661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.018007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.019012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaea05c9d05e4e4c96331ecd1447ff0c', 'request_id': 'req-423c6f46-5fdc-4b30-95e1-adf8138a70df'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.029033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaea05c9d05e4e4c96331ecd1447ff0c', 'request_id': 'req-423c6f46-5fdc-4b30-95e1-adf8138a70df'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.036459 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaea05c9d05e4e4c96331ecd1447ff0c', 'request_id': 'req-423c6f46-5fdc-4b30-95e1-adf8138a70df'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.036963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.038168 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.051773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] The token cache is being invalidate because project eaea05c9d05e4e4c96331ecd1447ff0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:21.052118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.052794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-423c6f46-5fdc-4b30-95e1-adf8138a70df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.054540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1296/2550] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:20 2021] DELETE /identity/v3/projects/eaea05c9d05e4e4c96331ecd1447ff0c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:21.062706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b70e4-e40f-405f-9e7d-3b723527408f None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.063384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b70e4-e40f-405f-9e7d-3b723527408f None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.064202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b70e4-e40f-405f-9e7d-3b723527408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.086547 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f08b70e4-e40f-405f-9e7d-3b723527408f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.088701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f08b70e4-e40f-405f-9e7d-3b723527408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.113302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1255/2551] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:21.125718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.127318 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.192335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1297/2552] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:21.203421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.204325 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.205010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.220234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c50350-99a8-46c7-940d-60dee7cac433 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.224213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.224863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.225147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.225497 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.231891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.233171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.235812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.237267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.241250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1298/2553] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:21.245009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.245009 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.249027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1256/2554] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:21.250501 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.256927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516263c8-e65a-4408-949c-c01705e2b8c7 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.262371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.263094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61770fce-9241-48ed-8992-9806f21bf197 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.263374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.263755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.264119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] PATH_INFO: `/v3/users/52cdef746c4b4704aacf1706babfaa4b` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.265470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52cdef746c4b4704aacf1706babfaa4b)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.267392 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.269967 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.270545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.270924 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.271298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.272182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:21.272611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.274360 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.286979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1257/2555] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:31:21.291003 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.302196 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658911db-2ebe-4255-a8f5-67f4e5d3f057 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.309048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.309802 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.310277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.310571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.311495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.313759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.332947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52cdef746c4b4704aacf1706babfaa4b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.347374 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1258/2556] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:21.352405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.353157 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52cdef746c4b4704aacf1706babfaa4b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.354076 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52cdef746c4b4704aacf1706babfaa4b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.354940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52cdef746c4b4704aacf1706babfaa4b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.366285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ea70b8b0-4fa1-4dab-b9d0-e895a56f62b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52cdef746c4b4704aacf1706babfaa4b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.381241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1299/2557] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:21 2021] DELETE /identity/v3/users/52cdef746c4b4704aacf1706babfaa4b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:21.388428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.388823 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.389285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.410755 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.412202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.420529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f055b51-893d-40bb-95b3-365704649e18 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.475468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1300/2558] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:21.490677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.491607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.491935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.492716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.494248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.495737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.496613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.497753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.521266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1259/2559] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:21.525338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.528413 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.545838 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb83187-0ffc-434a-8f08-a181d26b78e3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.560151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.560842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.561158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.561436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.562219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.571454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.574357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a149bf-0a06-48ac-82b6-790cadb764d2 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.580180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.580852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.581689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.581988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.589298 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1260/2560] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:21.590450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.592799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.597274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.598819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.610501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1301/2561] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:21.610953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0357f5-8e4e-4bf6-80b2-d09d1d9aa3f0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.612805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.617350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.619004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.619365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.619757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] PATH_INFO: `/v3/projects/274c06f5ad1b40f4ac5b99b168dd3ad7` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.621165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274c06f5ad1b40f4ac5b99b168dd3ad7)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.623065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.623387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48c613-9351-4ce7-a689-d0ba804b0530 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.629235 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.630329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.630690 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.631040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.632004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.633577 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.645203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1302/2562] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:21.649374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.660385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea71bc-7032-4d6f-9550-c0466e189cd3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.666516 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad4408-b856-4ef5-b000-bb28e455571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.667578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad4408-b856-4ef5-b000-bb28e455571c admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.667901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad4408-b856-4ef5-b000-bb28e455571c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.668188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad4408-b856-4ef5-b000-bb28e455571c admin admin] PATH_INFO: `/v3/projects/2fba228d568f44b7b7a574e9c8e3f1e3/users/4ec84125754647b5a18da4a56b7a1081/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.685257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274c06f5ad1b40f4ac5b99b168dd3ad7', 'request_id': 'req-6bf26a71-edd0-4901-804a-411b34464d55'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.686899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad4408-b856-4ef5-b000-bb28e455571c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fba228d568f44b7b7a574e9c8e3f1e3, user_id=4ec84125754647b5a18da4a56b7a1081, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.692361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad4408-b856-4ef5-b000-bb28e455571c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.695555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274c06f5ad1b40f4ac5b99b168dd3ad7', 'request_id': 'req-6bf26a71-edd0-4901-804a-411b34464d55'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.706272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274c06f5ad1b40f4ac5b99b168dd3ad7', 'request_id': 'req-6bf26a71-edd0-4901-804a-411b34464d55'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.710199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1303/2563] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:21 2021] PUT /identity/v3/projects/2fba228d568f44b7b7a574e9c8e3f1e3/users/4ec84125754647b5a18da4a56b7a1081/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:21.739584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] The token cache is being invalidate because project 274c06f5ad1b40f4ac5b99b168dd3ad7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:21.740281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.741522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-6bf26a71-edd0-4901-804a-411b34464d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:21.745695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1261/2564] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:21 2021] DELETE /identity/v3/projects/274c06f5ad1b40f4ac5b99b168dd3ad7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:21.752127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf0d1-4210-4a9c-86b1-8fc7c6e6bde7 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.752610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf0d1-4210-4a9c-86b1-8fc7c6e6bde7 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.752996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677cf0d1-4210-4a9c-86b1-8fc7c6e6bde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.776597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.776884 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.777217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.810705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] MFA Rules not processed for user `4ec84125754647b5a18da4a56b7a1081`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.812124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.814780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-677cf0d1-4210-4a9c-86b1-8fc7c6e6bde7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.816023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-677cf0d1-4210-4a9c-86b1-8fc7c6e6bde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.910395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1304/2565] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:21.910675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1262/2566] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:21.911148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.911148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.911148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.919728 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.921668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.929890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:21.931648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:21.940465 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1305/2567] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:21.944788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.959261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25b254-7214-40bd-84a7-db127c70eb04 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:21.964252 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:21.964986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:21.965305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:21.965620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:21.966411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:21.966717 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:21.968608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:21.986786 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1306/2568] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:31:21.988987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:21.991605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.012189 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e926da-ffbc-4417-bf37-9576b8ed972f admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.016947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.017805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.018096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.018383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] PATH_INFO: `/v3/projects/9a36ab34524843298ebfd0e5e30557cc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.019587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a36ab34524843298ebfd0e5e30557cc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.021216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f95c68-9715-4dad-ac11-c206dfe3cb4a None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.023014 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.024917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.025542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.025828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.026106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.034982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.036454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.045450 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1263/2569] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:21 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:22.046033 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.057394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a8b83-cea4-4d39-a21e-b77a68cd7c3f service glance] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.062763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.065576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.065878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.066158 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.067051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.069010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.077337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a36ab34524843298ebfd0e5e30557cc', 'request_id': 'req-42f9f403-a960-4e5d-b3c1-0c52493a4895'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.085399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a36ab34524843298ebfd0e5e30557cc', 'request_id': 'req-42f9f403-a960-4e5d-b3c1-0c52493a4895'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.092994 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a36ab34524843298ebfd0e5e30557cc', 'request_id': 'req-42f9f403-a960-4e5d-b3c1-0c52493a4895'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.103661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1264/2570] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:22 2021] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:22.107195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.107553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] The token cache is being invalidate because project 9a36ab34524843298ebfd0e5e30557cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:22.107912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.109363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.114128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1307/2571] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:21 2021] DELETE /identity/v3/projects/9a36ab34524843298ebfd0e5e30557cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:22.115134 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.116495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.178378 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44602dd6-f7c3-4759-95c0-0870244a39b8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.183863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.184401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.184687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.184969 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.185679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.187578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.203959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9f403-a960-4e5d-b3c1-0c52493a4895 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.209540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.213477 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1265/2572] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:22 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:22.213638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.213638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.213638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] PATH_INFO: `/v3/users/8117405737fb45f2be081cfbc608280b` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.213638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8117405737fb45f2be081cfbc608280b)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.214310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.214900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.216163 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.234784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a919dd0-a9b6-4123-bb1e-87ec1072a555 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.240750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.241528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.241739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.242171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.242963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.245843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.261990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1266/2573] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:22 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:22.263178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.271836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8117405737fb45f2be081cfbc608280b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.275279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7e32-6c79-406f-b3b1-f4a6111a0787 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.280886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.281553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.281894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.282345 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.283103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.284753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.291922 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8117405737fb45f2be081cfbc608280b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.294040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8117405737fb45f2be081cfbc608280b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.294713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8117405737fb45f2be081cfbc608280b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.297117 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1267/2574] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:22.301630 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.303562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.304367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-25c42734-85bc-4ce8-b885-3caf5bd27c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8117405737fb45f2be081cfbc608280b'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.317065 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fba68-b975-4822-8ac4-28e333f7e3a5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.319668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1308/2575] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:22 2021] DELETE /identity/v3/users/8117405737fb45f2be081cfbc608280b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:22.321923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.324233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.324602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.325350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] PATH_INFO: `/v3/projects/79c5a0563e12451f8f122ca817c3affb/users/1634ae797b5e486c8b4c90925d495778/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.341581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c5a0563e12451f8f122ca817c3affb, user_id=1634ae797b5e486c8b4c90925d495778, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.344401 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.358737 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1268/2576] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:22 2021] PUT /identity/v3/projects/79c5a0563e12451f8f122ca817c3affb/users/1634ae797b5e486c8b4c90925d495778/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:22.414748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.415603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.415919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.445468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] MFA Rules not processed for user `1634ae797b5e486c8b4c90925d495778`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:22.446951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.536903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1309/2577] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:22 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:22.547819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.549509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.624752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3f031-c018-43b0-a061-918e7f6bb341 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.628998 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.629777 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.630048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.630339 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.639576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.640847 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.641166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:22.642379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.655671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1269/2578] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:22.708540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8257d7-66c2-410a-98e3-caab7f1ca2db None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.714061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.715075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.715357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.715650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] PATH_INFO: `/v3/projects/d22198f6986e41ecabac66380c68dff2` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.716867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22198f6986e41ecabac66380c68dff2)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.718763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.765238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22198f6986e41ecabac66380c68dff2', 'request_id': 'req-ce5a4671-d00a-47b1-9831-0a65107b88bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.771862 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22198f6986e41ecabac66380c68dff2', 'request_id': 'req-ce5a4671-d00a-47b1-9831-0a65107b88bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.778526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22198f6986e41ecabac66380c68dff2', 'request_id': 'req-ce5a4671-d00a-47b1-9831-0a65107b88bd'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.788854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] The token cache is being invalidate because project d22198f6986e41ecabac66380c68dff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:22.789148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.789801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.791420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1310/2579] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:22 2021] DELETE /identity/v3/projects/d22198f6986e41ecabac66380c68dff2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:22.795861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:22.808208 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c1198-7231-4d6e-ba88-fe932b61c18b service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:22.865790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:22.866862 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:22.867215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:22.867545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] PATH_INFO: `/v3/users/72220f829c1b43bf9c14b15cfa8c8cb0` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:22.868946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72220f829c1b43bf9c14b15cfa8c8cb0)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:22.871017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:22.935649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72220f829c1b43bf9c14b15cfa8c8cb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.943474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72220f829c1b43bf9c14b15cfa8c8cb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.944293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72220f829c1b43bf9c14b15cfa8c8cb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.957080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72220f829c1b43bf9c14b15cfa8c8cb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.964937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc89d738-462f-4c1b-9fb2-4943fa2663c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72220f829c1b43bf9c14b15cfa8c8cb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:22.972046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1270/2580] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:22 2021] DELETE /identity/v3/users/72220f829c1b43bf9c14b15cfa8c8cb0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:23.230658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.232129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:23.245119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a4671-d00a-47b1-9831-0a65107b88bd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.301194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.302055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.302340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.302634 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] PATH_INFO: `/v3/projects/fd53ca8ace1449e9abccd1fe452a62e1` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.303835 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd53ca8ace1449e9abccd1fe452a62e1)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.305764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.350053 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd53ca8ace1449e9abccd1fe452a62e1', 'request_id': 'req-82082c5b-10bb-4442-ac33-d5cf0372b37a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:23.356237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd53ca8ace1449e9abccd1fe452a62e1', 'request_id': 'req-82082c5b-10bb-4442-ac33-d5cf0372b37a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:23.362313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd53ca8ace1449e9abccd1fe452a62e1', 'request_id': 'req-82082c5b-10bb-4442-ac33-d5cf0372b37a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:23.372520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] The token cache is being invalidate because project fd53ca8ace1449e9abccd1fe452a62e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:23.372750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:23.373360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-82082c5b-10bb-4442-ac33-d5cf0372b37a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:23.375129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1311/2581] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:23 2021] DELETE /identity/v3/projects/fd53ca8ace1449e9abccd1fe452a62e1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:23.380837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.381130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.381410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.399096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:23.400435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:23.457661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1271/2582] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:23.466433 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.466724 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.466999 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.484617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:23.485798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:23.493964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1312/2583] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:23.497903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.507598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c7fe6-b451-4ac7-9f92-44c5d7553a5e None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.512903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.513552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.513841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.514125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.514872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:23.515187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.516805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.528344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1272/2584] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:31:23.532311 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.541339 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef10424-e07f-4a78-a6a5-52d15fa28bb3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.546062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.546709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.546993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.547268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.548004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.549884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.578756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1313/2585] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:23 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:23.582831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.592610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec171f6-a5e2-406e-9f3d-dbfc9337dd3b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.645795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.646455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.646735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.647010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.647745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.649654 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.668183 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1273/2586] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:23 2021] POST /identity/v3/users => generated 293 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:23.672381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.683027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48631-d595-494f-bb5c-38614b96c2c6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.688057 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.688726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.689016 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.689298 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.690103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.691721 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.702470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1314/2587] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:23.706130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.716022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d057e-6940-4388-9b20-d4f03e521c51 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.720662 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4e618-de42-4d5b-8213-7c8a78cea779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.721311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4e618-de42-4d5b-8213-7c8a78cea779 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.721595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4e618-de42-4d5b-8213-7c8a78cea779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.721873 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4e618-de42-4d5b-8213-7c8a78cea779 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.722609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4e618-de42-4d5b-8213-7c8a78cea779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.724224 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4e618-de42-4d5b-8213-7c8a78cea779 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.734310 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1274/2588] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:23.738181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.748438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1961a-5ddd-4d6b-a9d0-9c2ae39bd5bd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.753412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.754289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.754573 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.754849 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] PATH_INFO: `/v3/projects/00555c9dc6b94b048368752dc235deba/users/52a9719a05fc4cc79e9096ae8746c382/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.768941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00555c9dc6b94b048368752dc235deba, user_id=52a9719a05fc4cc79e9096ae8746c382, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.771603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.784437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1315/2589] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:23 2021] PUT /identity/v3/projects/00555c9dc6b94b048368752dc235deba/users/52a9719a05fc4cc79e9096ae8746c382/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:23.789303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.789596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.789908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.808331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:23.809509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:23.871101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1275/2590] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:23.881047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:23.882725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:23.939040 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6decc-36e6-44a6-92cd-d0578131a03c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:23.942974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a81dd-0e0b-4d50-b824-30cc739e8256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:23.943646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a81dd-0e0b-4d50-b824-30cc739e8256 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:23.943947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a81dd-0e0b-4d50-b824-30cc739e8256 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:23.944658 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a81dd-0e0b-4d50-b824-30cc739e8256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:23.955095 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a81dd-0e0b-4d50-b824-30cc739e8256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:23.956567 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a81dd-0e0b-4d50-b824-30cc739e8256 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:23.966522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1316/2591] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:27.156869 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:27.158929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:27.176212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca75a7-786d-493f-80fd-848cd618dde6 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:27.209621 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:27.213730 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:27.214093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:27.214447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] PATH_INFO: `/v3/users/247089073e0e4975ac31c5e9cc03afc2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:27.220213 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=247089073e0e4975ac31c5e9cc03afc2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:27.224913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:27.307793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247089073e0e4975ac31c5e9cc03afc2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:27.318093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247089073e0e4975ac31c5e9cc03afc2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:27.319365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247089073e0e4975ac31c5e9cc03afc2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:27.334155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247089073e0e4975ac31c5e9cc03afc2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:27.341858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247089073e0e4975ac31c5e9cc03afc2'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:27.349741 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1276/2592] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:27 2021] DELETE /identity/v3/users/247089073e0e4975ac31c5e9cc03afc2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:27.355399 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:27.355974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:27.356191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:27.377212 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:27.379287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:27.454685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1317/2593] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:27.468498 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:27.470505 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:27.549643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489351-b8b1-4d41-a646-dc219a6628bf admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:27.558198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663956d0-7594-45e3-85f4-eda9baec0c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:27.558892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663956d0-7594-45e3-85f4-eda9baec0c2f service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:27.559179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663956d0-7594-45e3-85f4-eda9baec0c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:27.559461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663956d0-7594-45e3-85f4-eda9baec0c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:27.580442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663956d0-7594-45e3-85f4-eda9baec0c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:27.581919 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663956d0-7594-45e3-85f4-eda9baec0c2f service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:27.594246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1277/2594] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:28.116911 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.118846 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:28.137925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac59c14-3966-4254-85b2-f082c1e28db5 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.143395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.144315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.144608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.144891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] PATH_INFO: `/v3/projects/28271f8ffe50468b86ebf36c41287cbb` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.146108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28271f8ffe50468b86ebf36c41287cbb)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.148081 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.215760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28271f8ffe50468b86ebf36c41287cbb', 'request_id': 'req-bfe2c0da-4136-46b7-80bb-9b6d5878b729'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:28.230349 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28271f8ffe50468b86ebf36c41287cbb', 'request_id': 'req-bfe2c0da-4136-46b7-80bb-9b6d5878b729'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:28.238225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28271f8ffe50468b86ebf36c41287cbb', 'request_id': 'req-bfe2c0da-4136-46b7-80bb-9b6d5878b729'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:28.251887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] The token cache is being invalidate because project 28271f8ffe50468b86ebf36c41287cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:28.252166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:28.252989 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bfe2c0da-4136-46b7-80bb-9b6d5878b729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:28.255153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1318/2595] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:28 2021] DELETE /identity/v3/projects/28271f8ffe50468b86ebf36c41287cbb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:28.262486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027d993-da0a-4b98-a6ec-9cbdb9a14d9f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.263553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027d993-da0a-4b98-a6ec-9cbdb9a14d9f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.264534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027d993-da0a-4b98-a6ec-9cbdb9a14d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.290917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b027d993-da0a-4b98-a6ec-9cbdb9a14d9f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:28.292235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b027d993-da0a-4b98-a6ec-9cbdb9a14d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:28.303013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.303304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.303655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.334853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] MFA Rules not processed for user `52a9719a05fc4cc79e9096ae8746c382`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:28.336130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:28.361904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1278/2596] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:28.370083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.370436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.370724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.390503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:28.392007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:28.407191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1319/2597] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:28.412155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1279/2598] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:28.417006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.418023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.422646 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:28.439161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cda052-2fe9-44eb-9e45-74ae485bf40f None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.447073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.447952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.448331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.448679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.449422 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:28.449727 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.451093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6979ffc-2d4d-4f99-982f-f0c3c2a8e0b3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.451377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.455785 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.456448 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.456732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.457013 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.457726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.459727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.476238 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1280/2599] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:31:28.485084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.496993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d70acfa-fa32-4d32-a013-3415f03ae065 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.502453 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.503219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.503556 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.504045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.504819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.507029 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.510318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1320/2600] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:28.513711 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.552415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1281/2601] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/projects => generated 357 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:28.556282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.587326 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a37-e6f7-46df-b823-f048ddfc2ae7 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.633491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311a154-fd9b-4d22-8813-d53ed8cd2263 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.638762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.639726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.639858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.640225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.640941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.642890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.650412 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.651105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.651453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.652118 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.653103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.655004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.669568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1282/2602] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/users => generated 279 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:28.671668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.683309 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1321/2603] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:31:28.683828 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cc20e-73f3-4867-918a-6e031e016330 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.684592 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.688786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.689636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.689927 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.690204 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.690956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.692607 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.696480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d040859-f7ae-4af8-bb38-b4fcac3d6c98 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.702150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.702871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.703121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1283/2604] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:28.703319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.703454 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.704228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.705847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.706937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.717471 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed446a0a-912a-4fc4-bc05-aa412612e516 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.721443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1322/2605] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:28.722406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.725554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.726396 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.726759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.727119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.727962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.729785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.733150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57c01a-213c-4feb-b999-85f823a2a133 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.742515 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.744204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.744335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1284/2606] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:28.744467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.744569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] PATH_INFO: `/v3/projects/5d514b0df89d41d792d7672ec1168628/users/a655ced1dbb04d528f7b545e54515bc9/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.748167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.758739 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8ec9-462d-43e8-8959-832415fc2445 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.761155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d514b0df89d41d792d7672ec1168628, user_id=a655ced1dbb04d528f7b545e54515bc9, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.764411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.765167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f661ae-bfec-44a3-9487-a7e7caf053f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.766219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f661ae-bfec-44a3-9487-a7e7caf053f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.766513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f661ae-bfec-44a3-9487-a7e7caf053f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.766800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f661ae-bfec-44a3-9487-a7e7caf053f8 admin admin] PATH_INFO: `/v3/projects/a69f161bcc304b2983945f11b978cbd9/users/f827b270dc754b78aac4239c887ad1c4/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.780565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1323/2607] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:28 2021] PUT /identity/v3/projects/5d514b0df89d41d792d7672ec1168628/users/a655ced1dbb04d528f7b545e54515bc9/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:28.784589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f661ae-bfec-44a3-9487-a7e7caf053f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69f161bcc304b2983945f11b978cbd9, user_id=f827b270dc754b78aac4239c887ad1c4, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.784895 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.787423 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f661ae-bfec-44a3-9487-a7e7caf053f8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:28.805108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1285/2608] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:28 2021] PUT /identity/v3/projects/a69f161bcc304b2983945f11b978cbd9/users/f827b270dc754b78aac4239c887ad1c4/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:28.817748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.817963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.818323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.857216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] MFA Rules not processed for user `f827b270dc754b78aac4239c887ad1c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:28.859009 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:28.861980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5909be9-a1be-4e9f-8297-09dbb1eeb08c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:28.959375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1286/2609] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:31:28.963726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:28.975177 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:28.978336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:28.978864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:28.979511 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:28.980408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:28.983108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.013411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1324/2610] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:28 2021] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:31:29.018102 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.030648 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662b37a-e1b7-4f21-ba15-2dea5de4388a admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.037736 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.039029 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.039315 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.039700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] PATH_INFO: `/v3/projects/5d514b0df89d41d792d7672ec1168628/users/a655ced1dbb04d528f7b545e54515bc9/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.044466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d514b0df89d41d792d7672ec1168628, user_id=a655ced1dbb04d528f7b545e54515bc9, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.048085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.064351 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399c16f-4e6a-4b2d-b6cd-68135bf46350 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.072909 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1325/2611] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:29 2021] PUT /identity/v3/projects/5d514b0df89d41d792d7672ec1168628/users/a655ced1dbb04d528f7b545e54515bc9/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:29.160671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.161350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.161629 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.161906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.162805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.166040 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.199682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1287/2612] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:28 2021] POST /identity/v3/projects => generated 355 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:29.204307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.219917 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ce2b-6a4a-4f47-b525-6e595d2f87f4 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.326750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.327912 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.328201 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.328481 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.329420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.331361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.359397 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1326/2613] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:29 2021] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:29.360668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.374267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f4742-08f9-4db0-877d-c60995b7b7a8 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.381116 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.381892 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.382267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.382575 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.383994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.386094 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.399747 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1288/2614] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:29 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:29.402380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.413283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ffa7ac-44ec-4a20-8cb1-f86d0c2faf19 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.420023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.421103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.421533 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.421845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] PATH_INFO: `/v3/projects/c8703c0264b24287873a380abff9157d/users/0ce7182506f64b2ab49ec6dfbf909a5e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.442957 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8703c0264b24287873a380abff9157d, user_id=0ce7182506f64b2ab49ec6dfbf909a5e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.447314 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.467806 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1327/2615] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:29 2021] PUT /identity/v3/projects/c8703c0264b24287873a380abff9157d/users/0ce7182506f64b2ab49ec6dfbf909a5e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:29.469337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.482230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2e7a9-87af-41de-8da4-8d1c8c541fed admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.589717 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ed093-9c5e-4242-8da4-3e142c7f5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.590397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed093-9c5e-4242-8da4-3e142c7f5dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.590685 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed093-9c5e-4242-8da4-3e142c7f5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.590966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ed093-9c5e-4242-8da4-3e142c7f5dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.591866 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ed093-9c5e-4242-8da4-3e142c7f5dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.593460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ed093-9c5e-4242-8da4-3e142c7f5dfb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.604782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1289/2616] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:29 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:29.609060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.629033 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e7f3-ccf1-4da3-ac77-94359379e147 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.636571 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.637003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.637291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.637675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] PATH_INFO: `/v3/projects/c8703c0264b24287873a380abff9157d/users/0ce7182506f64b2ab49ec6dfbf909a5e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.639614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8703c0264b24287873a380abff9157d, user_id=0ce7182506f64b2ab49ec6dfbf909a5e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.642652 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.659285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1328/2617] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:29 2021] PUT /identity/v3/projects/c8703c0264b24287873a380abff9157d/users/0ce7182506f64b2ab49ec6dfbf909a5e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:31:29.669822 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.670112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.670398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.697788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] MFA Rules not processed for user `0ce7182506f64b2ab49ec6dfbf909a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:29.699093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:29.777599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1290/2618] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:29 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:29.790374 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.796605 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:29.876543 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ffcee-e88a-468f-b3fd-5bea622518d8 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:29.881667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f2001-e1f9-4b8d-956e-72703131dd01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:29.882385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2001-e1f9-4b8d-956e-72703131dd01 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:29.882686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2001-e1f9-4b8d-956e-72703131dd01 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:29.883020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f2001-e1f9-4b8d-956e-72703131dd01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:29.896123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f2001-e1f9-4b8d-956e-72703131dd01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:29.897644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f2001-e1f9-4b8d-956e-72703131dd01 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:29.909613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1329/2619] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:29 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:29.998061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:29.999855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:30.014221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f87272-4d76-4c4d-a239-f6adb4e47f78 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:30.020010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:30.022113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:30.022333 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:30.022611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:30.125416 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:30.127022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:30.138600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1291/2620] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:29 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:31:33.820501 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d5d8-6bb5-4fcc-8bee-8e87e6839f55 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:33.822037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d5d8-6bb5-4fcc-8bee-8e87e6839f55 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:33.822590 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03d5d8-6bb5-4fcc-8bee-8e87e6839f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:33.865167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-7b03d5d8-6bb5-4fcc-8bee-8e87e6839f55 None None] MFA Rules not processed for user `a655ced1dbb04d528f7b545e54515bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:33.869915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7b03d5d8-6bb5-4fcc-8bee-8e87e6839f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:33.964748 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1330/2621] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:33 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:33.977430 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:33.979949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:34.041710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764a6b8-0020-44dc-bb5e-d93c08707da6 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:34.045366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:34.046014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:34.046302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:34.046583 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:34.105400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:34.106861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:34.116287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1292/2622] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:33 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:34.228148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac67c-c077-4141-a683-6231dabd7a6a None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:34.228580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac67c-c077-4141-a683-6231dabd7a6a None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:34.229001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ac67c-c077-4141-a683-6231dabd7a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:34.291967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-9d4ac67c-c077-4141-a683-6231dabd7a6a None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:34.294216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-9d4ac67c-c077-4141-a683-6231dabd7a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:34.389002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1331/2623] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 05:31:34 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:34.453513 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:34.454951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:34.550146 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae3e3d-859f-490e-a70e-dacdbb5a12b1 service glance] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:34.556335 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718307d-0688-427d-af31-ef251856b97f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:34.556996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718307d-0688-427d-af31-ef251856b97f service swift] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:34.557286 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718307d-0688-427d-af31-ef251856b97f service swift] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:34.557574 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718307d-0688-427d-af31-ef251856b97f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:34.573809 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718307d-0688-427d-af31-ef251856b97f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:34.577048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718307d-0688-427d-af31-ef251856b97f service swift] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:34.585970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1293/2624] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 05:31:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 05:31:44.392230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:44.392738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:44.392834 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:44.409588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] MFA Rules not processed for user `52a9719a05fc4cc79e9096ae8746c382`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:44.410759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:44.420411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1332/2625] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:44 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:44.670885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718307d-0688-427d-af31-ef251856b97f service swift] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:44.672395 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6718307d-0688-427d-af31-ef251856b97f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:44.738537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718307d-0688-427d-af31-ef251856b97f service swift] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:44.742221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:44.743476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:44.743801 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:44.744089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:44.745865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:44.755707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:44.757138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310a59a-3e9e-4cab-a364-a65571953d20 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:44.765292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1294/2626] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:44 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:45.104002 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:45.105507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:45.207071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdb5cc-a0c0-4dcb-8b3e-f71dcf2ee070 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:45.212945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:45.213826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:45.214149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:45.214437 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:45.216485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:45.229170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:45.230772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:45.240877 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1333/2627] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:45 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:51.585242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:51.585681 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:51.586057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:51.604683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:51.606077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:51.613751 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1295/2628] 10.222.0.41 () {58 vars in 1009 bytes} [Tue Nov 9 05:31:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:51.627967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:51.640305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3778-4091-465c-a252-5cb19d798ad7 service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:51.648195 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:51.648938 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:51.649232 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:51.649781 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:51.658795 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:51.660476 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:51.669733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1334/2629] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 05:31:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 05:31:54.814325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:54.816516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:54.829386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49dcfa-8149-447d-9b62-3a6849f98641 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:54.833985 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:54.834748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:54.835336 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:54.836383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:54.838854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:54.910148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:54.911699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:54.921934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1296/2630] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:55.540828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:55.542469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:55.580380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b965d68-bdbf-4816-97f4-6d5393d544ad service swift] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:55.586720 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:55.587597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:55.588072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:55.588491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] PATH_INFO: `/v3/users/e4b8ce2b334d42c8bf0196e992180e0f` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:55.590001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b8ce2b334d42c8bf0196e992180e0f)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:55.592769 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:55.678822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b8ce2b334d42c8bf0196e992180e0f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:55.703682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b8ce2b334d42c8bf0196e992180e0f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:55.705008 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b8ce2b334d42c8bf0196e992180e0f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:55.705921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b8ce2b334d42c8bf0196e992180e0f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:55.744532 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b8ce2b334d42c8bf0196e992180e0f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:55.761361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1335/2631] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:55 2021] DELETE /identity/v3/users/e4b8ce2b334d42c8bf0196e992180e0f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:55.945096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:55.963392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecafad9-8c7b-478b-8f8b-183c9b6f3520 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:56.032187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:56.033172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:56.033558 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:56.033908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] PATH_INFO: `/v3/projects/79869bd25d3c47ca87597d1801b9d710` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:56.037934 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79869bd25d3c47ca87597d1801b9d710)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:56.040530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:56.099957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79869bd25d3c47ca87597d1801b9d710', 'request_id': 'req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:56.109980 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79869bd25d3c47ca87597d1801b9d710', 'request_id': 'req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:56.130971 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79869bd25d3c47ca87597d1801b9d710', 'request_id': 'req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:56.147905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] The token cache is being invalidate because project 79869bd25d3c47ca87597d1801b9d710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:56.148603 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:56.149491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-dc6955eb-4802-42d5-8cb7-f412dc9a4e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:56.151723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1297/2632] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:55 2021] DELETE /identity/v3/projects/79869bd25d3c47ca87597d1801b9d710 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:57.473587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:57.475192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:57.489022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b29f1d-8fff-4ab0-a480-a15726b3116b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:57.545772 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:57.546333 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:57.546615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:57.546890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] PATH_INFO: `/v3/users/1634ae797b5e486c8b4c90925d495778` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:57.548140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1634ae797b5e486c8b4c90925d495778)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:57.550636 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:57.609491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1634ae797b5e486c8b4c90925d495778'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:57.624308 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1634ae797b5e486c8b4c90925d495778'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:57.625192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1634ae797b5e486c8b4c90925d495778'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:57.625791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1634ae797b5e486c8b4c90925d495778'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:57.633805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1634ae797b5e486c8b4c90925d495778'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:57.646617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1336/2633] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:57 2021] DELETE /identity/v3/users/1634ae797b5e486c8b4c90925d495778 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:57.651119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:57.651678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:57.651766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:57.672187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:57.673620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:57.737746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1298/2634] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:57.748171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:57.749983 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:57.806269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3225ebf-5ce2-4e3c-9de7-b6d5b82792dc admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:57.810196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee8257-2d1b-4161-b5ef-83d335c31ffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:57.810856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8257-2d1b-4161-b5ef-83d335c31ffb service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:57.811144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8257-2d1b-4161-b5ef-83d335c31ffb service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:57.811424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee8257-2d1b-4161-b5ef-83d335c31ffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:57.820826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee8257-2d1b-4161-b5ef-83d335c31ffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:57.822301 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee8257-2d1b-4161-b5ef-83d335c31ffb service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:57.831677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1337/2635] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:58.124943 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.126371 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:58.150535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1a7c4-ad98-461c-8f3b-63003ee38f87 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.161149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.162135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.162418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.163004 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] PATH_INFO: `/v3/projects/79c5a0563e12451f8f122ca817c3affb` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.164888 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c5a0563e12451f8f122ca817c3affb)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.167067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.226766 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c5a0563e12451f8f122ca817c3affb', 'request_id': 'req-e3304a84-2210-4d53-85c7-26dadef8e33a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:58.252110 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c5a0563e12451f8f122ca817c3affb', 'request_id': 'req-e3304a84-2210-4d53-85c7-26dadef8e33a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:58.262990 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c5a0563e12451f8f122ca817c3affb', 'request_id': 'req-e3304a84-2210-4d53-85c7-26dadef8e33a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:58.284448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] The token cache is being invalidate because project 79c5a0563e12451f8f122ca817c3affb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:58.284744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:58.285433 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-e3304a84-2210-4d53-85c7-26dadef8e33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:58.287452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1299/2636] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:58 2021] DELETE /identity/v3/projects/79c5a0563e12451f8f122ca817c3affb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:58.295000 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.295295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.295584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.333628 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:58.335103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:58.400778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1338/2637] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:58.425872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.430573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.430573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.460380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:58.465121 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:58.475499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1300/2638] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:58.479901 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.491154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d97e5-03fb-47db-8095-c665186552b1 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.496291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.496993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.497261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.497545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.498722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:31:58.499041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.500988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.520322 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1339/2639] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:31:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:31:58.521930 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.532588 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10eadb7-4d4c-49a9-ba22-98fc8cef4b77 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.556136 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.556824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.557113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.557390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.558124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.560083 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.609161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1301/2640] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:31:58 2021] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:58.614370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.627276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89926418-23b7-43d3-a826-85eabc2272e0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.688484 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.689166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.689452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.689845 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.690584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.693062 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.715951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1340/2641] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:31:58 2021] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:31:58.719938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.731404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66b2f56-a2a3-4fe1-b6cf-b1ffc0f2d096 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.736017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.736675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.736957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.737231 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.737970 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.739555 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.753729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1302/2642] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:58.756168 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.770477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a4d2c-c9f3-420d-b6f6-5357e8b21572 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.775208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c70de-355e-4ffc-95cb-e755e7388ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.775924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c70de-355e-4ffc-95cb-e755e7388ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.776213 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c70de-355e-4ffc-95cb-e755e7388ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.776495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c70de-355e-4ffc-95cb-e755e7388ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.777245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c70de-355e-4ffc-95cb-e755e7388ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.778960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c70de-355e-4ffc-95cb-e755e7388ce5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.792666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1341/2643] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:31:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:31:58.793807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.804878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49c34-ea98-4f89-9a7e-eda614440a9d admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:58.815807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:58.816989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.817278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.817562 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] PATH_INFO: `/v3/projects/25a6f064285043599e21cf661ad8afc2/users/b4ddaa1daad04d359dd1d3c4e3390b4a/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.834645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a6f064285043599e21cf661ad8afc2, user_id=b4ddaa1daad04d359dd1d3c4e3390b4a, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:58.837397 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:58.852256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1303/2644] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:31:58 2021] PUT /identity/v3/projects/25a6f064285043599e21cf661ad8afc2/users/b4ddaa1daad04d359dd1d3c4e3390b4a/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:58.863468 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:58.863793 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:58.864104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:58.893108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] MFA Rules not processed for user `b4ddaa1daad04d359dd1d3c4e3390b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:58.894539 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:58.961357 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1342/2645] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:58 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:58.971917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:58.973578 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:59.044756 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb96eb-34c0-4fe0-be05-26938d0069c2 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:59.048987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48afa5a2-cec3-4c14-b34f-84d957eaaf43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:59.049835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa5a2-cec3-4c14-b34f-84d957eaaf43 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:59.050205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa5a2-cec3-4c14-b34f-84d957eaaf43 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:59.050488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48afa5a2-cec3-4c14-b34f-84d957eaaf43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:59.060522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afa5a2-cec3-4c14-b34f-84d957eaaf43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:59.061963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48afa5a2-cec3-4c14-b34f-84d957eaaf43 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:59.071488 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1304/2646] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:58 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:59.095960 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:59.161763 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b10d1-2aec-4802-a7b6-f94d3015cfaa None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:59.167505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:59.168530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:59.168815 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:59.169093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] PATH_INFO: `/v3/users/b4ddaa1daad04d359dd1d3c4e3390b4a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:59.170406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ddaa1daad04d359dd1d3c4e3390b4a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:59.172388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:59.218709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ddaa1daad04d359dd1d3c4e3390b4a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.231936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ddaa1daad04d359dd1d3c4e3390b4a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.232774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ddaa1daad04d359dd1d3c4e3390b4a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.233975 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ddaa1daad04d359dd1d3c4e3390b4a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.243063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ddaa1daad04d359dd1d3c4e3390b4a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.258902 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1343/2647] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:59 2021] DELETE /identity/v3/users/b4ddaa1daad04d359dd1d3c4e3390b4a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:31:59.263404 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:59.263721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:59.264002 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:59.283026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:31:59.284406 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:59.348171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1305/2648] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:31:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:31:59.360082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:59.361610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:59.433155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99e57f-59bf-4810-a77e-f1d0aeb5c188 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:59.452355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:59.453295 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:59.453631 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:59.453910 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:59.472077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:59.473496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:59.485148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1344/2649] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:31:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:31:59.831841 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:59.833261 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:59.867354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79baf27e-b8be-4684-b3ae-674068a0b827 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:59.873976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:31:59.875066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:31:59.875355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:31:59.875661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] PATH_INFO: `/v3/projects/25a6f064285043599e21cf661ad8afc2` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:31:59.877557 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a6f064285043599e21cf661ad8afc2)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:31:59.879695 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:31:59.942006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a6f064285043599e21cf661ad8afc2', 'request_id': 'req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.944287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:31:59.946267 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:31:59.952703 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a6f064285043599e21cf661ad8afc2', 'request_id': 'req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.967173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fee4-21a3-4691-82dd-d506069dee4c service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:31:59.976293 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a6f064285043599e21cf661ad8afc2', 'request_id': 'req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:31:59.995675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] The token cache is being invalidate because project 25a6f064285043599e21cf661ad8afc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:31:59.996591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.010093 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8eb4a844-33bd-4fb7-abdd-08fbd40c9663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.012124 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1306/2650] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:31:59 2021] DELETE /identity/v3/projects/25a6f064285043599e21cf661ad8afc2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:00.019323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee961b4-cde1-4f16-97da-92faa4c2b9d8 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.019658 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee961b4-cde1-4f16-97da-92faa4c2b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.019921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee961b4-cde1-4f16-97da-92faa4c2b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.052142 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.053046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.053334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.053611 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] PATH_INFO: `/v3/users/f827b270dc754b78aac4239c887ad1c4` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.055296 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-dee961b4-cde1-4f16-97da-92faa4c2b9d8 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:00.055424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f827b270dc754b78aac4239c887ad1c4)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.057109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-dee961b4-cde1-4f16-97da-92faa4c2b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.057404 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.077106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1307/2651] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:00.086674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.089956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.089956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.119834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:00.121267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.131666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1308/2652] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:00.137172 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.147320 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ec22f-8571-41d6-9542-98caee64bc8d None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.153572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.154543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.154963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.155199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f827b270dc754b78aac4239c887ad1c4'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.155689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.156926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:32:00.157319 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.160138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.183942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1309/2653] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:32:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:32:00.184697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f827b270dc754b78aac4239c887ad1c4'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.185462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f827b270dc754b78aac4239c887ad1c4'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.186080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f827b270dc754b78aac4239c887ad1c4'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.189001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.198418 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.204666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2b203842-3312-43f0-9a2f-54e6369590a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f827b270dc754b78aac4239c887ad1c4'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:00.219290 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1345/2654] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:31:59 2021] DELETE /identity/v3/users/f827b270dc754b78aac4239c887ad1c4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:32:00.224467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.225084 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.225470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.227773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3b3c1-c240-41fc-be3f-1b9c0b88661e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.263651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:00.263651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.328045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.329076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.329549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.330018 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.331104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.337060 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.364288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1346/2655] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:00.377633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1310/2656] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:00 2021] POST /identity/v3/projects => generated 399 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:00.379878 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.381407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.384255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.472310 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fb94a-a0eb-41d2-af01-df85aee74271 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.485500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cfa4-c064-4ee5-8415-a2c5e73d4de7 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.490432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.491377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.491377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.491686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.492979 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.497571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.529635 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1311/2657] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:00 2021] POST /identity/v3/users => generated 300 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:00.530178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.530905 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.531202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.531488 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.537151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.542203 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.543774 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.548299 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b185-44fa-44dc-b129-b0dbfc06a889 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.553703 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1347/2658] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:32:00.568141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.569848 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.571968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.572466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.573211 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.581744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.595524 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1312/2659] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:00 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:00.597133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.608520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b10c-007a-4c44-bbb7-b7c24a33cd9c service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.614353 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec30b1-1bf4-4c5b-956c-2a202fd8242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.615285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec30b1-1bf4-4c5b-956c-2a202fd8242f admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.615722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec30b1-1bf4-4c5b-956c-2a202fd8242f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.616012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec30b1-1bf4-4c5b-956c-2a202fd8242f admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.617420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec30b1-1bf4-4c5b-956c-2a202fd8242f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.619139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec30b1-1bf4-4c5b-956c-2a202fd8242f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.636216 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1348/2660] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:00 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:00.640620 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.651243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d4e7d-ffc6-4e54-b9c7-4bfdc36aaa8c admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.656461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.657363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.659543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.659908 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] PATH_INFO: `/v3/projects/0e1ea22a66f449f9ae41e970e6cf32dd/users/985d11cbe4e24bfeb87a938f9f0951d5/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.681437 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1ea22a66f449f9ae41e970e6cf32dd, user_id=985d11cbe4e24bfeb87a938f9f0951d5, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.685230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.709579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1313/2661] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:00 2021] PUT /identity/v3/projects/0e1ea22a66f449f9ae41e970e6cf32dd/users/985d11cbe4e24bfeb87a938f9f0951d5/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:00.721047 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.722288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.722584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.786151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] MFA Rules not processed for user `985d11cbe4e24bfeb87a938f9f0951d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:00.787294 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.863447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1349/2662] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:00 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:00.875291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.879165 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.904106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:00.906173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:00.944139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66682fd9-0899-400c-a088-83ed04e7a309 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.948699 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.949341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.949624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.949901 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.958915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.960454 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:00.971598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1314/2663] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:00 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:00.979726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f64f61-d761-4a91-b5fa-088bf96c1e5b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:00.984843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:00.986505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:00.986891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:00.987417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] PATH_INFO: `/v3/projects/a69f161bcc304b2983945f11b978cbd9` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:00.988920 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69f161bcc304b2983945f11b978cbd9)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:00.995245 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:01.054535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69f161bcc304b2983945f11b978cbd9', 'request_id': 'req-a1877e7d-a681-47f6-99b4-3280d80f0638'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.069607 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69f161bcc304b2983945f11b978cbd9', 'request_id': 'req-a1877e7d-a681-47f6-99b4-3280d80f0638'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.077319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69f161bcc304b2983945f11b978cbd9', 'request_id': 'req-a1877e7d-a681-47f6-99b4-3280d80f0638'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.097955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] The token cache is being invalidate because project a69f161bcc304b2983945f11b978cbd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:01.098319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.099054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.100861 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1350/2664] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:00 2021] DELETE /identity/v3/projects/a69f161bcc304b2983945f11b978cbd9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:01.105327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:01.119999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2901e-bb94-4ae9-8f55-29861358c140 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:01.187400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:01.189058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:01.190618 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:01.190915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] PATH_INFO: `/v3/users/0ce7182506f64b2ab49ec6dfbf909a5e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:01.192530 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ce7182506f64b2ab49ec6dfbf909a5e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:01.194660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:01.253542 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ce7182506f64b2ab49ec6dfbf909a5e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.264398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ce7182506f64b2ab49ec6dfbf909a5e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.265041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ce7182506f64b2ab49ec6dfbf909a5e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.278442 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ce7182506f64b2ab49ec6dfbf909a5e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.287356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-51307591-acd7-493a-8cbb-ac332eb64c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ce7182506f64b2ab49ec6dfbf909a5e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.293993 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1315/2665] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:01 2021] DELETE /identity/v3/users/0ce7182506f64b2ab49ec6dfbf909a5e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:32:01.743305 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:01.744974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:01.758727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1877e7d-a681-47f6-99b4-3280d80f0638 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:01.817942 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:01.818813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:01.819100 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:01.819387 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] PATH_INFO: `/v3/projects/c8703c0264b24287873a380abff9157d` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:01.820668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8703c0264b24287873a380abff9157d)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:01.822656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:01.868996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8703c0264b24287873a380abff9157d', 'request_id': 'req-75df79db-cc97-44e5-a20c-c0b5f8efba39'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.876329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8703c0264b24287873a380abff9157d', 'request_id': 'req-75df79db-cc97-44e5-a20c-c0b5f8efba39'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.882668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8703c0264b24287873a380abff9157d', 'request_id': 'req-75df79db-cc97-44e5-a20c-c0b5f8efba39'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.892562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] The token cache is being invalidate because project c8703c0264b24287873a380abff9157d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:01.892856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.893485 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-75df79db-cc97-44e5-a20c-c0b5f8efba39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:01.895022 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1351/2666] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:01 2021] DELETE /identity/v3/projects/c8703c0264b24287873a380abff9157d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:01.901255 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:01.901725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:01.901819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:01.919529 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:01.920791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:01.979356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1316/2667] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:01.988249 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:01.988542 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:01.988853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.007085 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:02.008826 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:02.016584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1352/2668] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:02.020624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.033129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0101a1-7420-4979-9bdf-6ba577299db6 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.037779 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.038426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.038716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.039007 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.039773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:32:02.040084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.042024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.060240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1317/2669] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:32:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:32:02.064296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.074756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1721d89-c3ac-40aa-9a84-1fe9d7b894ac None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.080520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.081186 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.081474 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.081754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.082478 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.084420 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.114419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1353/2670] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:02 2021] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:32:02.118805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.129790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bec9f7b-274d-42b8-b1cd-1df4f959b3af admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.186230 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.186902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.187188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.187465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.188206 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.190123 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.210355 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1318/2671] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:02 2021] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:32:02.215094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.225007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c029561-c528-4834-b37f-68fbdadb3a92 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.229608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.230244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.230534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.230816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.231558 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.233175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.243369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1354/2672] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:02 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:02.247097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.257073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a112e0-aff0-4ec8-8930-812774e83bed admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.262532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a886a-1fb2-4040-8427-97ce7834bf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.263221 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a886a-1fb2-4040-8427-97ce7834bf04 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.263508 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a886a-1fb2-4040-8427-97ce7834bf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.263834 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a886a-1fb2-4040-8427-97ce7834bf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.264581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a886a-1fb2-4040-8427-97ce7834bf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.266187 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a886a-1fb2-4040-8427-97ce7834bf04 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.277116 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1319/2673] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:02.284773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.295272 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08816d11-33e3-43b0-827e-c0b9ea951af5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.300188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.301104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.301388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.301784 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] PATH_INFO: `/v3/projects/e6871b5adf96404e94a3b44c1975232a/users/95203b9bccd8410aae265a93d317aeb0/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.317856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6871b5adf96404e94a3b44c1975232a, user_id=95203b9bccd8410aae265a93d317aeb0, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.321685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.336251 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1355/2674] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:02 2021] PUT /identity/v3/projects/e6871b5adf96404e94a3b44c1975232a/users/95203b9bccd8410aae265a93d317aeb0/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:02.346048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.346344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.346820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.375197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] MFA Rules not processed for user `95203b9bccd8410aae265a93d317aeb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:02.376668 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:02.447420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1320/2675] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:02 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:02.452461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.519244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da39a-d58b-4183-9ec6-4beb97091253 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.524005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.524680 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.524972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.525257 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.525976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.527894 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.554927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1356/2676] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:02 2021] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:02.560021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.573184 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29487f-4308-42e7-b9a0-08ecc8a55421 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.629587 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.630292 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.630581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.630860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.631637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.634141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.655798 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1321/2677] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:02 2021] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:02.659885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.670381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a88cf-eb51-4b47-946c-ce84b06608b3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.675208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.675992 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.676354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.676712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.677626 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.679871 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.690880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1357/2678] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:02.695532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.707139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef66fa-68fe-493c-a581-8b6a98f3b9ff admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.712932 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.713826 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.714112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.714390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] PATH_INFO: `/v3/projects/01422b6ea1d941dc9abb56df2fdd5ab4/users/a3bfbe81f6044d81a9f51026145e724e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.730400 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01422b6ea1d941dc9abb56df2fdd5ab4, user_id=a3bfbe81f6044d81a9f51026145e724e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.733141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.746402 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1322/2679] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:02 2021] PUT /identity/v3/projects/01422b6ea1d941dc9abb56df2fdd5ab4/users/a3bfbe81f6044d81a9f51026145e724e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:02.750461 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.760741 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb8b31-eeb7-496d-9431-f2723733f8d2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.817447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb2973-1704-4b85-ab80-ba22391f1a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.818123 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb2973-1704-4b85-ab80-ba22391f1a4e admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.818407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb2973-1704-4b85-ab80-ba22391f1a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.818685 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb2973-1704-4b85-ab80-ba22391f1a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.819425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb2973-1704-4b85-ab80-ba22391f1a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.821093 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb2973-1704-4b85-ab80-ba22391f1a4e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.830889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1358/2680] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:02 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:02.834602 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.846836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8012c-c6d3-45a4-9283-698b585b2114 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:02.852008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:02.852906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.853176 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.853452 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] PATH_INFO: `/v3/projects/01422b6ea1d941dc9abb56df2fdd5ab4/users/a3bfbe81f6044d81a9f51026145e724e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.855589 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01422b6ea1d941dc9abb56df2fdd5ab4, user_id=a3bfbe81f6044d81a9f51026145e724e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:02.858274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:02.874675 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1323/2681] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:02 2021] PUT /identity/v3/projects/01422b6ea1d941dc9abb56df2fdd5ab4/users/a3bfbe81f6044d81a9f51026145e724e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:02.885450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:02.885746 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:02.886035 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:02.912941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] MFA Rules not processed for user `a3bfbe81f6044d81a9f51026145e724e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:02.914693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:02.983023 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1359/2682] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:02 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:02.994182 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:02.996131 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:03.053451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6880e2-cad6-4cec-941b-0255d33f4848 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:03.057903 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:03.058660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:03.059050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:03.059481 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:03.069543 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:03.071113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:03.081240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1324/2683] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:02 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:03.152551 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:03.163150 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dadf71-4dd1-4a98-8fd8-9898668c7ff4 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:03.168052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c941b4d-eb87-42d3-80ee-dc7f0f1d35cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:03.168712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c941b4d-eb87-42d3-80ee-dc7f0f1d35cc service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:03.169004 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c941b4d-eb87-42d3-80ee-dc7f0f1d35cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:03.169289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c941b4d-eb87-42d3-80ee-dc7f0f1d35cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:03.225552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c941b4d-eb87-42d3-80ee-dc7f0f1d35cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:03.227554 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c941b4d-eb87-42d3-80ee-dc7f0f1d35cc service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:03.236149 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1360/2684] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:03 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:14.131827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:14.190721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6420ba-90cc-4260-8759-a4a74ab62297 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:14.195219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:14.196109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:14.196392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:14.196676 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] PATH_INFO: `/v3/users/95203b9bccd8410aae265a93d317aeb0` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:14.197860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95203b9bccd8410aae265a93d317aeb0)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:14.199807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:14.242831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95203b9bccd8410aae265a93d317aeb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.249661 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95203b9bccd8410aae265a93d317aeb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.250449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95203b9bccd8410aae265a93d317aeb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.261933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95203b9bccd8410aae265a93d317aeb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.268381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95203b9bccd8410aae265a93d317aeb0'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.274259 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1325/2685] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:14 2021] DELETE /identity/v3/users/95203b9bccd8410aae265a93d317aeb0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:14.278965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933933d6-6306-4332-af95-35db8506dfed None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:14.279464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933933d6-6306-4332-af95-35db8506dfed None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:14.279553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933933d6-6306-4332-af95-35db8506dfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:14.296587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-933933d6-6306-4332-af95-35db8506dfed None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:14.297775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-933933d6-6306-4332-af95-35db8506dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:14.362588 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1361/2686] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:14.369267 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:14.370660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:14.429024 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333e96a-fdcb-412f-b8f7-007735d61939 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:14.432832 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:14.433475 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:14.433757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:14.434032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:14.443073 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:14.444537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:14.454314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1326/2687] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:14.709291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933933d6-6306-4332-af95-35db8506dfed None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:14.710727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-933933d6-6306-4332-af95-35db8506dfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:14.725495 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933933d6-6306-4332-af95-35db8506dfed None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:14.730263 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:14.731174 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:14.731460 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:14.731773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] PATH_INFO: `/v3/projects/e6871b5adf96404e94a3b44c1975232a` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:14.732969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6871b5adf96404e94a3b44c1975232a)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:14.734914 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:14.781171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6871b5adf96404e94a3b44c1975232a', 'request_id': 'req-2c9c555f-5046-4025-b783-313f37b42de5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.787304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6871b5adf96404e94a3b44c1975232a', 'request_id': 'req-2c9c555f-5046-4025-b783-313f37b42de5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.793565 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6871b5adf96404e94a3b44c1975232a', 'request_id': 'req-2c9c555f-5046-4025-b783-313f37b42de5'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.803467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] The token cache is being invalidate because project e6871b5adf96404e94a3b44c1975232a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:14.803797 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.804417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.805941 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1362/2688] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:14 2021] DELETE /identity/v3/projects/e6871b5adf96404e94a3b44c1975232a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:14.809938 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:14.819305 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd304bf-1112-4e93-a9ac-b63169535cdb service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:14.872864 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:14.873962 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:14.874244 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:14.874517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] PATH_INFO: `/v3/users/a3bfbe81f6044d81a9f51026145e724e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:14.875716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3bfbe81f6044d81a9f51026145e724e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:14.877617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:14.920819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3bfbe81f6044d81a9f51026145e724e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.927323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3bfbe81f6044d81a9f51026145e724e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.927949 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3bfbe81f6044d81a9f51026145e724e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.939657 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3bfbe81f6044d81a9f51026145e724e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.946078 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-f0bed2db-4d2c-4254-bcd9-1a574c807602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3bfbe81f6044d81a9f51026145e724e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:14.951612 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1327/2689] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:14 2021] DELETE /identity/v3/users/a3bfbe81f6044d81a9f51026145e724e => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:15.205985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.207393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:15.220794 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c555f-5046-4025-b783-313f37b42de5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.274819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.275803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.276090 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.276369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] PATH_INFO: `/v3/projects/01422b6ea1d941dc9abb56df2fdd5ab4` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.277553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] RBAC: Authorizing `identity:delete_project(project_id=01422b6ea1d941dc9abb56df2fdd5ab4)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.279432 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.322130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01422b6ea1d941dc9abb56df2fdd5ab4', 'request_id': 'req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:15.328697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01422b6ea1d941dc9abb56df2fdd5ab4', 'request_id': 'req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:15.334615 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01422b6ea1d941dc9abb56df2fdd5ab4', 'request_id': 'req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:15.345052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] The token cache is being invalidate because project 01422b6ea1d941dc9abb56df2fdd5ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:15.345347 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:15.345964 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-91d2fe2f-7f5f-4247-83a3-44a502dbfaac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:15.347464 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1363/2690] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:15 2021] DELETE /identity/v3/projects/01422b6ea1d941dc9abb56df2fdd5ab4 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:15.353290 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.353750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.353865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.371341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:15.372641 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:15.432056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1328/2691] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:15.438230 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.438526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.438953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.457470 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:15.458659 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:15.467007 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1364/2692] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:15.471219 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.480535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9a4ed-8261-4ff3-baab-8daab8027833 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.485063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.485705 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.485989 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.486265 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.486999 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:32:15.487308 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.488946 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.500148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1329/2693] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:32:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:32:15.504128 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.513523 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246da7a-6e13-4007-911d-42d3e2fe4352 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.518041 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.518675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.518962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.519236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.519988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.521864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.547642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1365/2694] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/projects => generated 409 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:15.551738 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.561649 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff7935-0974-441a-92fe-f70b2ca2ed03 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.617106 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.618089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.618509 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.618912 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.619939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.621872 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.643683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1330/2695] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:32:15.647667 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.658452 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a42586-b15c-45e9-bf0a-b04f066bb879 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.663129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.663890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.664225 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.664499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.665242 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.667055 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.678949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1366/2696] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:15.682880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.692865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612ef03-7369-4eb9-8655-74462367be74 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.698197 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78dcbd-96ab-49d9-805c-0dd57676ae58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.698861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78dcbd-96ab-49d9-805c-0dd57676ae58 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.699146 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78dcbd-96ab-49d9-805c-0dd57676ae58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.699432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78dcbd-96ab-49d9-805c-0dd57676ae58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.700240 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78dcbd-96ab-49d9-805c-0dd57676ae58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.701814 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78dcbd-96ab-49d9-805c-0dd57676ae58 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.712280 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1331/2697] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:15.716363 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.725887 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4a4fc-6d30-4c3b-a28b-4d3a73661104 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.730676 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.731553 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.731876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.732156 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] PATH_INFO: `/v3/projects/bc1172083611411bb6766246a0736e8b/users/99344bd5827b49459f381512d1cad416/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.745969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1172083611411bb6766246a0736e8b, user_id=99344bd5827b49459f381512d1cad416, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.748923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.761982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1367/2698] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:15 2021] PUT /identity/v3/projects/bc1172083611411bb6766246a0736e8b/users/99344bd5827b49459f381512d1cad416/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:32:15.772593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.773156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.773539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.802585 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] MFA Rules not processed for user `99344bd5827b49459f381512d1cad416`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:15.803820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:15.836928 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.838620 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:15.872367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1332/2699] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:15.877289 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.896924 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef4fd4-35c9-49d1-99f2-9da08d66e003 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.901028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.901841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.902133 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.902418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.904210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:15.913666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.915130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.922967 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1368/2700] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:15 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:32:15.938329 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c8d90-7138-4e9c-b1c5-82d58bd98a78 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:15.942868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:15.943522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:15.943861 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:15.944139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:15.944837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:15.947344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:15.974793 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1333/2701] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:15.976435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:15.987341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f44c8-5b23-47e7-98cd-0c39a662016b service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.043198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.044031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.044384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.044734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.045637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.047764 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.069423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1369/2702] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:15 2021] POST /identity/v3/users => generated 311 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:32:16.074037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.084791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffb394-f447-40a9-a97a-8f7679dde32a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.089436 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.090103 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.090387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.090665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.091451 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.093140 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.104731 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1334/2703] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:32:16.108873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.119210 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13ba20-209e-4962-9d19-245622ce4572 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.124127 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.124959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.125241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.125518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] PATH_INFO: `/v3/projects/e7055477b29e4f75be721587262ec645/users/8c3d06fc4d8a4d59b079c18cff4aeacd/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.140320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7055477b29e4f75be721587262ec645, user_id=8c3d06fc4d8a4d59b079c18cff4aeacd, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.142949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.157500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1370/2704] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:16 2021] PUT /identity/v3/projects/e7055477b29e4f75be721587262ec645/users/8c3d06fc4d8a4d59b079c18cff4aeacd/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:32:16.161382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.171272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb4a72-12d0-452b-a300-21074ce7ac6a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.230540 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b03357-f183-4eef-8740-7ae705872112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.231271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b03357-f183-4eef-8740-7ae705872112 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.231579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b03357-f183-4eef-8740-7ae705872112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.231914 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b03357-f183-4eef-8740-7ae705872112 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.232665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b03357-f183-4eef-8740-7ae705872112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.234270 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b03357-f183-4eef-8740-7ae705872112 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.245853 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1335/2705] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:16 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:16.250998 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.261594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd10a0-81da-4b98-9ac8-03b5a11d9317 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.267469 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.268642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.269144 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.269552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] PATH_INFO: `/v3/projects/e7055477b29e4f75be721587262ec645/users/8c3d06fc4d8a4d59b079c18cff4aeacd/roles/94424be31c964c5686644e854119e1dc` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.272103 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7055477b29e4f75be721587262ec645, user_id=8c3d06fc4d8a4d59b079c18cff4aeacd, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.275545 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.287097 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1371/2706] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:16 2021] PUT /identity/v3/projects/e7055477b29e4f75be721587262ec645/users/8c3d06fc4d8a4d59b079c18cff4aeacd/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:16.349102 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.349398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.349686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.383321 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] MFA Rules not processed for user `8c3d06fc4d8a4d59b079c18cff4aeacd`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:16.384671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:16.469431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1336/2707] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:16 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:16.479770 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.481471 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:16.568416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e996c8a-1434-43a5-824b-2e8227aaa039 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.568592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.569940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:16.574038 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.576069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.576443 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.576804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.591124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.593948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.606453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1372/2708] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:16 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:16.685590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4201413-0250-4eec-9818-e68f42bd16ca None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.696441 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.697108 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.697399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.697679 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.699572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:16.730729 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.732463 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.749732 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1337/2709] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:16 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:16.790006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:16.800180 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda039a-c41c-46bb-9c66-f3e40ec2033b service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:16.805261 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f452b5b-c4c2-4d9e-a3fe-3c0378c6e87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:16.805933 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f452b5b-c4c2-4d9e-a3fe-3c0378c6e87e service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:16.806287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f452b5b-c4c2-4d9e-a3fe-3c0378c6e87e service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:16.806803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f452b5b-c4c2-4d9e-a3fe-3c0378c6e87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:16.866682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f452b5b-c4c2-4d9e-a3fe-3c0378c6e87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:16.868360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f452b5b-c4c2-4d9e-a3fe-3c0378c6e87e service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:16.877729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1373/2710] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:16 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:20.377702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:20.379098 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:20.452327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef396f-7a35-455e-9020-75978dbd83ff service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:20.456833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:20.457696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:20.457981 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:20.458258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] PATH_INFO: `/v3/users/985d11cbe4e24bfeb87a938f9f0951d5` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:20.459464 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985d11cbe4e24bfeb87a938f9f0951d5)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:20.461428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:20.505316 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985d11cbe4e24bfeb87a938f9f0951d5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:20.512701 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985d11cbe4e24bfeb87a938f9f0951d5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:20.513291 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985d11cbe4e24bfeb87a938f9f0951d5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:20.524392 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985d11cbe4e24bfeb87a938f9f0951d5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:20.530898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985d11cbe4e24bfeb87a938f9f0951d5'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:20.536645 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1338/2711] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:20 2021] DELETE /identity/v3/users/985d11cbe4e24bfeb87a938f9f0951d5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:20.541208 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:20.541670 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:20.541775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:20.558718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:20.559946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:20.616593 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1374/2712] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:20.627212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:20.628611 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:20.685740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82b51e-1d45-4e17-98a9-21e14ffe58d1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:20.689367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:20.690016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:20.690301 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:20.690581 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:20.699917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:20.701344 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:20.710590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1339/2713] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:20.962082 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:20.963524 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:20.975096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9970da-b060-4c68-93a5-cb1d73575a72 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:20.980692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:20.981855 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:20.982147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:20.982436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] PATH_INFO: `/v3/projects/0e1ea22a66f449f9ae41e970e6cf32dd` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:20.983692 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1ea22a66f449f9ae41e970e6cf32dd)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:20.985617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:21.032847 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1ea22a66f449f9ae41e970e6cf32dd', 'request_id': 'req-1a65da04-970e-44e0-8648-b258c9b2abc3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:21.039401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1ea22a66f449f9ae41e970e6cf32dd', 'request_id': 'req-1a65da04-970e-44e0-8648-b258c9b2abc3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:21.045987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1ea22a66f449f9ae41e970e6cf32dd', 'request_id': 'req-1a65da04-970e-44e0-8648-b258c9b2abc3'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:21.056219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] The token cache is being invalidate because project 0e1ea22a66f449f9ae41e970e6cf32dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:21.056453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:21.057073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1a65da04-970e-44e0-8648-b258c9b2abc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:21.058585 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1375/2714] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:20 2021] DELETE /identity/v3/projects/0e1ea22a66f449f9ae41e970e6cf32dd => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:28.316026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:28.317489 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:28.330199 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73596f3d-0128-4833-bae0-2a44f9b39ea9 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:28.384220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:28.385128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:28.385461 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:28.385733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] PATH_INFO: `/v3/users/4ec84125754647b5a18da4a56b7a1081` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:28.386910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec84125754647b5a18da4a56b7a1081)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:28.388858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:28.432032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec84125754647b5a18da4a56b7a1081'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.440171 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec84125754647b5a18da4a56b7a1081'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.440808 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec84125754647b5a18da4a56b7a1081'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.452868 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec84125754647b5a18da4a56b7a1081'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.459492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec84125754647b5a18da4a56b7a1081'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.465573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1340/2715] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:28 2021] DELETE /identity/v3/users/4ec84125754647b5a18da4a56b7a1081 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:28.470136 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:28.470616 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:28.470843 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:28.489048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:28.490340 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:28.549856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1376/2716] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:28.559996 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:28.561408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:28.621383 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bb660-9a55-4eb8-8ffe-7d3c60aa2d9f admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:28.625239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ffe9b-db6e-4a65-b6bb-84adf800e680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:28.625900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ffe9b-db6e-4a65-b6bb-84adf800e680 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:28.626161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ffe9b-db6e-4a65-b6bb-84adf800e680 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:28.626435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ffe9b-db6e-4a65-b6bb-84adf800e680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:28.635086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ffe9b-db6e-4a65-b6bb-84adf800e680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:28.636584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188ffe9b-db6e-4a65-b6bb-84adf800e680 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:28.645465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1341/2717] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:28.895743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:28.897217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:28.912513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49071158-2476-4ef8-a985-29ba728e0ef3 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:28.919527 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:28.920584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:28.920856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:28.921148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] PATH_INFO: `/v3/projects/2fba228d568f44b7b7a574e9c8e3f1e3` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:28.922610 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fba228d568f44b7b7a574e9c8e3f1e3)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:28.924716 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:28.971997 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fba228d568f44b7b7a574e9c8e3f1e3', 'request_id': 'req-9823c95c-d29d-4ef9-b442-eb2ac8052d76'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.979364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fba228d568f44b7b7a574e9c8e3f1e3', 'request_id': 'req-9823c95c-d29d-4ef9-b442-eb2ac8052d76'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.985701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fba228d568f44b7b7a574e9c8e3f1e3', 'request_id': 'req-9823c95c-d29d-4ef9-b442-eb2ac8052d76'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.996264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] The token cache is being invalidate because project 2fba228d568f44b7b7a574e9c8e3f1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:28.996562 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.997250 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-9823c95c-d29d-4ef9-b442-eb2ac8052d76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:28.999021 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1377/2718] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:28 2021] DELETE /identity/v3/projects/2fba228d568f44b7b7a574e9c8e3f1e3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:29.004749 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.005041 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.005341 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.023506 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:29.025426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.083923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1342/2719] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:29.093612 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.094108 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.094507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.109483 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.110944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.118874 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:29.120211 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.134154 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1378/2720] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:29.135293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.145044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d7535-226c-4c60-8cc4-ac452dae9b24 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.159472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.160264 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.160621 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.160968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.161798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:32:29.162178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.163890 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.181743 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1379/2721] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:32:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:32:29.182899 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.193665 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e9c8e-1003-4dee-8639-dec263a5e862 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.199152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.200139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.200139 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.200393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.201151 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.203425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.203805 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a41b7d-5eba-4047-8182-65d473ce95b7 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.210021 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.210666 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.210951 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.211256 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.213599 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.226959 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.228746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.233931 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1380/2722] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:29 2021] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:29.234832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.236662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.240491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1343/2723] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:29.244527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.255431 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18435f68-1bff-4fc7-b4d7-b10ed78e252f service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.300681 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817d772-517f-4754-bae9-0c7e72e308c3 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.309265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.310190 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.310473 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.310758 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] PATH_INFO: `/v3/users/99344bd5827b49459f381512d1cad416` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.312155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99344bd5827b49459f381512d1cad416)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.315148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.315291 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.316051 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.316548 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.316858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.317854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.320553 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.343145 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1344/2724] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:29 2021] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:29.347087 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.357677 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeebb1f-5d56-4a98-957a-718995227ed5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.363523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.364337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.364572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.364851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.365912 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.367274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.369606 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99344bd5827b49459f381512d1cad416'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:29.379262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1345/2725] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:32:29.382770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.384498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99344bd5827b49459f381512d1cad416'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:29.385355 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99344bd5827b49459f381512d1cad416'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:29.386679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99344bd5827b49459f381512d1cad416'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:29.393976 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee6996-6b9e-4e4a-aeb4-4396a220b6e5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.395148 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-3fdfb2f7-025a-4609-818c-d3c536c2e548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99344bd5827b49459f381512d1cad416'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:29.399080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.399815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.400104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.400386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.401141 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.402720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.409737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1381/2726] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:29 2021] DELETE /identity/v3/users/99344bd5827b49459f381512d1cad416 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:29.414048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.414391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.414682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.415937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1346/2727] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:29.419691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.422001 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.436942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deac687-cef7-41be-b50a-12b78de14259 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.438807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:29.440088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.499340 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2634f-d0f9-4203-b0d8-8be9c9ee53fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.500277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2634f-d0f9-4203-b0d8-8be9c9ee53fb admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.500565 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2634f-d0f9-4203-b0d8-8be9c9ee53fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.500845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2634f-d0f9-4203-b0d8-8be9c9ee53fb admin admin] PATH_INFO: `/v3/projects/a0b68818a05f440ab5e5f388fa37cc30/users/edd088ca791b4a4489e513b31007ae5d/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.507921 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1382/2728] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:29.513687 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.515276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.517101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2634f-d0f9-4203-b0d8-8be9c9ee53fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b68818a05f440ab5e5f388fa37cc30, user_id=edd088ca791b4a4489e513b31007ae5d, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.520095 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2634f-d0f9-4203-b0d8-8be9c9ee53fb admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.535700 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1347/2729] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:29 2021] PUT /identity/v3/projects/a0b68818a05f440ab5e5f388fa37cc30/users/edd088ca791b4a4489e513b31007ae5d/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:32:29.544865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.545155 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.545466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.572746 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] MFA Rules not processed for user `edd088ca791b4a4489e513b31007ae5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:29.573939 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.577255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc09d-a829-4fc5-8a40-af3741e85095 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.625923 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.626576 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.626867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.627145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.641137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1348/2730] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:29 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:29.653591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.654994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.698427 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.699990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.711166 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1383/2731] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:32:29.714281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9b331-bfaa-4d49-a7a2-e7aed9db2958 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:29.718365 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cef991f3ef34b09ad2251ef7e416a91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:29.718682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:29.718966 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:29.719242 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:29.729061 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:29.730503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:29.739576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1349/2732] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:29 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:29.981564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:29.983078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:29.999341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2118d1-5e4c-4eae-b5db-74ad3a2dd476 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:30.005529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:30.006401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:30.006699 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:30.007397 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] PATH_INFO: `/v3/projects/bc1172083611411bb6766246a0736e8b` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:30.008907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1172083611411bb6766246a0736e8b)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:30.011241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:30.061381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1172083611411bb6766246a0736e8b', 'request_id': 'req-53b85103-9242-4660-9a6c-3bb30cf40622'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.071436 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1172083611411bb6766246a0736e8b', 'request_id': 'req-53b85103-9242-4660-9a6c-3bb30cf40622'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.078274 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1172083611411bb6766246a0736e8b', 'request_id': 'req-53b85103-9242-4660-9a6c-3bb30cf40622'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.088821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] The token cache is being invalidate because project bc1172083611411bb6766246a0736e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:30.089122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.089776 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.091307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1384/2733] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:29 2021] DELETE /identity/v3/projects/bc1172083611411bb6766246a0736e8b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:30.095448 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:30.106910 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6a3e9-2283-4f3f-8c7f-e22b5f3b29f9 service glance] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:30.170034 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:30.171260 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:30.171920 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:30.172294 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] PATH_INFO: `/v3/users/8c3d06fc4d8a4d59b079c18cff4aeacd` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:30.176063 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3d06fc4d8a4d59b079c18cff4aeacd)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:30.177997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:30.275851 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3d06fc4d8a4d59b079c18cff4aeacd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.283050 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3d06fc4d8a4d59b079c18cff4aeacd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.283687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3d06fc4d8a4d59b079c18cff4aeacd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.295902 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3d06fc4d8a4d59b079c18cff4aeacd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.302282 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-d47dd936-acd4-4f70-b590-2c589d0f326a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3d06fc4d8a4d59b079c18cff4aeacd'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:30.308043 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1350/2734] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:30 2021] DELETE /identity/v3/users/8c3d06fc4d8a4d59b079c18cff4aeacd => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:30.879754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:30.881204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:30.894980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85103-9242-4660-9a6c-3bb30cf40622 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:30.955693 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:30.956650 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:30.957005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:30.957331 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] PATH_INFO: `/v3/projects/e7055477b29e4f75be721587262ec645` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:30.958709 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7055477b29e4f75be721587262ec645)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:30.960800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.005832 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7055477b29e4f75be721587262ec645', 'request_id': 'req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:31.013752 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7055477b29e4f75be721587262ec645', 'request_id': 'req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:31.020049 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7055477b29e4f75be721587262ec645', 'request_id': 'req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:31.030821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] The token cache is being invalidate because project e7055477b29e4f75be721587262ec645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:31.031205 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:31.031951 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-2d05e4ab-d59d-41b5-bd19-1b780e684d9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:31.033804 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1385/2735] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:30 2021] DELETE /identity/v3/projects/e7055477b29e4f75be721587262ec645 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:31.040389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.040881 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.041302 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.059500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:31.060718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:31.120056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1351/2736] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:31.128104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b66d-a092-4844-8c99-56caef92589d None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.128402 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b66d-a092-4844-8c99-56caef92589d None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.128677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046b66d-a092-4844-8c99-56caef92589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.147493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c046b66d-a092-4844-8c99-56caef92589d None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:31.148722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c046b66d-a092-4844-8c99-56caef92589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:31.156401 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1386/2737] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:31.160600 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.172745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b88b-0a46-49e8-8545-5f1c15f6a4fe None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.178134 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.178720 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.179016 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.179279 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.180143 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:32:31.180547 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.182579 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.198714 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1352/2738] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:32:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:32:31.199837 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b66d-a092-4844-8c99-56caef92589d None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.209063 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046b66d-a092-4844-8c99-56caef92589d None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.214088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.214802 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.215025 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.215304 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.216350 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.218361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.248946 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1387/2739] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:31.250212 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.260366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33ef10-1b9b-44b7-92e3-326502f24f51 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.318561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.319235 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.319647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.319936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.320694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.322626 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.342084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1353/2740] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:31.346237 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.356864 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506da5c-4d5f-4d83-9269-88898c379736 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.361853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.362513 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.362801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.363080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.363918 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.365531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.378867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1388/2741] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:31 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:32:31.382889 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.393066 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f66c2b-75f3-4d55-b1bf-e34ba8a03f9a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.397800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53460f96-be47-4496-b02c-dc85bd63d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.398432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53460f96-be47-4496-b02c-dc85bd63d7dd admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.398716 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53460f96-be47-4496-b02c-dc85bd63d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.398994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53460f96-be47-4496-b02c-dc85bd63d7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.399780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53460f96-be47-4496-b02c-dc85bd63d7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.401375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53460f96-be47-4496-b02c-dc85bd63d7dd admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.417337 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1354/2742] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:31 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:31.421477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.432256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5db1ce-66ad-454a-a3f4-cdde3a2f65dd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.436908 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.437779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.438061 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.438335 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] PATH_INFO: `/v3/projects/764da491f74340938f925460d99afb28/users/0b731df2fbdb48f790e1bea973f75307/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.452370 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764da491f74340938f925460d99afb28, user_id=0b731df2fbdb48f790e1bea973f75307, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.455119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.467147 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1389/2743] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:31 2021] PUT /identity/v3/projects/764da491f74340938f925460d99afb28/users/0b731df2fbdb48f790e1bea973f75307/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:31.479836 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.480148 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.480426 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.508755 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] MFA Rules not processed for user `0b731df2fbdb48f790e1bea973f75307`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:31.509956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:31.572410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1355/2744] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:31.576943 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.637805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b3682-9003-4ce1-ad80-0b950e3c3106 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.642383 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.643034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.643318 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.643596 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.644321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.646181 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.675367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1390/2745] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:31.676536 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.687795 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af776c-25ca-4bee-9c07-66226c35d775 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.743517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.744268 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.744551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.744915 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.745687 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.747913 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.766923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1356/2746] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:32:31.770937 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.781367 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534db26c-eb0e-4172-9232-2f2520cb351d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.786300 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.786982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.787268 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.787733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.788365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.790017 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.801803 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1391/2747] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:31 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:31.805933 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.815770 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600600-c90b-4c47-a1ad-1cbf402ee0c1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.820363 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.821262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.821545 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.821824 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] PATH_INFO: `/v3/projects/64aa300d715b42fbab46fac8c555182d/users/dfebfd346a6a4dca86577dc20fbb2b7e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.836870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64aa300d715b42fbab46fac8c555182d, user_id=dfebfd346a6a4dca86577dc20fbb2b7e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.839926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.853942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1357/2748] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:31 2021] PUT /identity/v3/projects/64aa300d715b42fbab46fac8c555182d/users/dfebfd346a6a4dca86577dc20fbb2b7e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:31.857892 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.867456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8de65-8114-42ef-a3dc-59545248369d admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.924380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf0aa8-d46a-4696-81a4-11f3f1647605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.925078 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0aa8-d46a-4696-81a4-11f3f1647605 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.925361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0aa8-d46a-4696-81a4-11f3f1647605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.925635 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf0aa8-d46a-4696-81a4-11f3f1647605 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.926372 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0aa8-d46a-4696-81a4-11f3f1647605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.927988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf0aa8-d46a-4696-81a4-11f3f1647605 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.937587 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1392/2749] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:31 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:32:31.941736 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:31.952057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8e1db-feb6-40c2-9297-16447dad61d0 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:31.956997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:31.957879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.958147 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.958409 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] PATH_INFO: `/v3/projects/64aa300d715b42fbab46fac8c555182d/users/dfebfd346a6a4dca86577dc20fbb2b7e/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:31.960447 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64aa300d715b42fbab46fac8c555182d, user_id=dfebfd346a6a4dca86577dc20fbb2b7e, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:31.963785 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:31.977053 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1358/2750] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:31 2021] PUT /identity/v3/projects/64aa300d715b42fbab46fac8c555182d/users/dfebfd346a6a4dca86577dc20fbb2b7e/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:31.987719 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:31.988006 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:31.988285 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:32.015184 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] MFA Rules not processed for user `dfebfd346a6a4dca86577dc20fbb2b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:32.016423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:32.083762 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1393/2751] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:31 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:32.095064 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:32.096900 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:32.157192 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5379de-82c9-46db-812d-bb58685bf113 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:32.160986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:32.161632 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:32.161921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:32.162201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:32.172740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:32.174429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:32.184906 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1359/2752] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:32 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:32.259968 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:32.261591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:32.274564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca68707-dae4-4410-aeb2-3e338d5a2a8b None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:32.278655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7012ab-bb53-4dde-ba43-cf4928a1abe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:32.279312 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7012ab-bb53-4dde-ba43-cf4928a1abe4 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:32.279603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7012ab-bb53-4dde-ba43-cf4928a1abe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:32.279930 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7012ab-bb53-4dde-ba43-cf4928a1abe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:32.337947 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7012ab-bb53-4dde-ba43-cf4928a1abe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:32.339380 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7012ab-bb53-4dde-ba43-cf4928a1abe4 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:32.349811 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1394/2753] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:32 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:32.602788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:32.665389 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b99d8-7cd6-4ee2-98bb-b296c6adcc93 service cinder] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:32.670281 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:32.671332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:32.671647 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:32.671922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] PATH_INFO: `/v3/users/0b731df2fbdb48f790e1bea973f75307` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:32.673164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b731df2fbdb48f790e1bea973f75307)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:32.675089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:32.729827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b731df2fbdb48f790e1bea973f75307'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:32.738129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b731df2fbdb48f790e1bea973f75307'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:32.739058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b731df2fbdb48f790e1bea973f75307'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:32.755254 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b731df2fbdb48f790e1bea973f75307'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:32.761957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b731df2fbdb48f790e1bea973f75307'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:32.767911 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1360/2754] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:32 2021] DELETE /identity/v3/users/0b731df2fbdb48f790e1bea973f75307 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:32.772574 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:32.772872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:32.773152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:32.791686 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:32.792988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:32.852976 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1395/2755] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:32.863303 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:32.865350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:32.926682 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e53c8-d7c5-4311-98f8-0c1492cb4370 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:32.930783 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:32.931633 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:32.932109 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:32.932476 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:32.946517 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:32.948561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:32.963667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1361/2756] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:33.249779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:33.251293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:33.265875 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d883c-f168-4455-8df5-85eb242bf36e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:33.270730 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:33.271727 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:33.272077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:33.272423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] PATH_INFO: `/v3/projects/764da491f74340938f925460d99afb28` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:33.274654 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764da491f74340938f925460d99afb28)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:33.276531 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:33.324112 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764da491f74340938f925460d99afb28', 'request_id': 'req-d77e427a-eecb-482c-99b5-7b444bb4ba05'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.333313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764da491f74340938f925460d99afb28', 'request_id': 'req-d77e427a-eecb-482c-99b5-7b444bb4ba05'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.340060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764da491f74340938f925460d99afb28', 'request_id': 'req-d77e427a-eecb-482c-99b5-7b444bb4ba05'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.349959 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] The token cache is being invalidate because project 764da491f74340938f925460d99afb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:33.350254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.350873 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.353058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1396/2757] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:33 2021] DELETE /identity/v3/projects/764da491f74340938f925460d99afb28 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:33.357057 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:33.367590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c25d6-f22b-474d-9d2e-1cf9b86a37a1 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:33.422523 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:33.423381 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:33.423694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:33.423973 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] PATH_INFO: `/v3/users/dfebfd346a6a4dca86577dc20fbb2b7e` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:33.425151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfebfd346a6a4dca86577dc20fbb2b7e)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:33.427046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:33.473312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfebfd346a6a4dca86577dc20fbb2b7e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.480151 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfebfd346a6a4dca86577dc20fbb2b7e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.480759 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfebfd346a6a4dca86577dc20fbb2b7e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.491975 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfebfd346a6a4dca86577dc20fbb2b7e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.499674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-1aa568ca-1a3d-40f7-943b-b0b5710ac5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfebfd346a6a4dca86577dc20fbb2b7e'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.506077 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1362/2758] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:32:33 2021] DELETE /identity/v3/users/dfebfd346a6a4dca86577dc20fbb2b7e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:33.780518 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:33.782155 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:33.794865 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e427a-eecb-482c-99b5-7b444bb4ba05 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:33.851020 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:33.852712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:33.852712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:33.852712 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] PATH_INFO: `/v3/projects/64aa300d715b42fbab46fac8c555182d` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:33.853662 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=64aa300d715b42fbab46fac8c555182d)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:33.855564 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:33.902753 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64aa300d715b42fbab46fac8c555182d', 'request_id': 'req-af41bd9f-9c29-4342-8802-f1fda6c14b8f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.909275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64aa300d715b42fbab46fac8c555182d', 'request_id': 'req-af41bd9f-9c29-4342-8802-f1fda6c14b8f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.915490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64aa300d715b42fbab46fac8c555182d', 'request_id': 'req-af41bd9f-9c29-4342-8802-f1fda6c14b8f'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.925430 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] The token cache is being invalidate because project 64aa300d715b42fbab46fac8c555182d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:32:33.925722 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.926351 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-af41bd9f-9c29-4342-8802-f1fda6c14b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:32:33.927954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1397/2759] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:32:33 2021] DELETE /identity/v3/projects/64aa300d715b42fbab46fac8c555182d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:33.934132 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:33.934419 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:33.934696 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:33.952191 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:33.953362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:34.012843 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1363/2760] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:34.020578 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.020886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.021175 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.045544 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:34.046766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:34.054775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1398/2761] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:34.059394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.069076 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a55153-ec93-432b-97c3-baffdecffa32 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.074239 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.074887 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.075243 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.075554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.076332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:32:34.076643 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.078220 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.090863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1364/2762] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:32:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:32:34.095375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.104556 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c5e6-1878-4a57-8297-867fd5e190ad None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.109198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.109848 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.110138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.110421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.111141 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.113072 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.143220 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1399/2763] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:34 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:34.144715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.157591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347c483-07f3-4ab5-b670-64fbb51e088e admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.216469 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.217153 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.217435 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.217710 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.218434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.220377 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.240638 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1365/2764] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:34 2021] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:34.245434 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.255988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0214c8a-53bf-42fe-989c-53e98d415a30 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.260854 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.261520 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.261812 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.262094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.262982 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.264627 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.280258 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1400/2765] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:34 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:34.284233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.297420 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1d213-547b-498c-9510-78adfec457c6 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.302100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf4bc7-fa23-4e81-aaa3-b3005e5ab6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.302790 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf4bc7-fa23-4e81-aaa3-b3005e5ab6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.303105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf4bc7-fa23-4e81-aaa3-b3005e5ab6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.303388 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf4bc7-fa23-4e81-aaa3-b3005e5ab6e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.304167 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf4bc7-fa23-4e81-aaa3-b3005e5ab6e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.306382 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf4bc7-fa23-4e81-aaa3-b3005e5ab6e6 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.319551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1366/2766] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:34 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:34.320819 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.331671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ac041-e119-44b6-9bb3-0b4a9014cfcf admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.339178 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.340209 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.340472 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.341182 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] PATH_INFO: `/v3/projects/4dc498cab6aa40d2b4929df08abc9e02/users/d2457318b0094619b0fd1499f2c5732d/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.359171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc498cab6aa40d2b4929df08abc9e02, user_id=d2457318b0094619b0fd1499f2c5732d, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.362027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.377354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1401/2767] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:34 2021] PUT /identity/v3/projects/4dc498cab6aa40d2b4929df08abc9e02/users/d2457318b0094619b0fd1499f2c5732d/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:32:34.385819 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b732f-ed8b-4719-b0f1-e9f3632012d4 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.386370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b732f-ed8b-4719-b0f1-e9f3632012d4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.386370 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b732f-ed8b-4719-b0f1-e9f3632012d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.409982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6b0b732f-ed8b-4719-b0f1-e9f3632012d4 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:34.411185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6b0b732f-ed8b-4719-b0f1-e9f3632012d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:34.469974 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1367/2768] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:34.480591 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:34.482334 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:34.554682 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30619af4-32df-4201-b6d6-91da28ab4483 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:34.558809 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:34.559500 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:34.559822 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:34.560105 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:34.571138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:34.572679 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:34.583073 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1402/2769] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:38.598387 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:38.598835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:38.598931 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:38.626757 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] MFA Rules not processed for user `d2457318b0094619b0fd1499f2c5732d`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:38.628010 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:38.701942 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1368/2770] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:38 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:38.707421 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:38.717446 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575066fc-2961-4edd-b66d-665a3a552598 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:38.721950 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:38.722597 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:38.722884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:38.723161 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:38.723893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:38.725767 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:38.757111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1403/2771] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:32:38 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:38.760799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:38.771637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7a625-7e09-447c-963c-1a8d2a0cc827 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:38.844885 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:38.845593 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:38.846006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:38.846223 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:38.846957 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:38.848953 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:38.875827 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1369/2772] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:32:38 2021] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:32:38.879820 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:38.890419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61db7-96b8-4f5c-a0af-639608127978 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:38.895069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:38.895857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:38.896146 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:38.896428 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:38.897346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:38.899058 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:38.917219 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1404/2773] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:38 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 09 05:32:38.920272 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:38.931278 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16509-7be5-4daa-83a6-fdf018a7e438 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:38.936023 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:38.936923 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:38.937258 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:38.937535 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] PATH_INFO: `/v3/projects/a382ccd5089b438f9eb9a963f5f7d1a1/users/6b1dc0e2cd1842ac98387af40127dc0f/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:38.952842 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a382ccd5089b438f9eb9a963f5f7d1a1, user_id=6b1dc0e2cd1842ac98387af40127dc0f, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:38.959672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:38.971725 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1370/2774] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:38 2021] PUT /identity/v3/projects/a382ccd5089b438f9eb9a963f5f7d1a1/users/6b1dc0e2cd1842ac98387af40127dc0f/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:38.975759 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:38.986546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810f2bb-47d5-417f-8b1b-0af35ef377e5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:39.049829 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:39.050505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:39.050792 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:39.051071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:39.051844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:39.053424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:39.065915 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1405/2775] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:32:38 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:32:39.069129 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:39.090362 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a66dcd-ae85-4ce5-a087-49e48ed3ab55 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:39.095937 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3bfd8-a2a3-4bb2-8650-bf28b2efa7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:39.097056 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3bfd8-a2a3-4bb2-8650-bf28b2efa7f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:39.097494 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3bfd8-a2a3-4bb2-8650-bf28b2efa7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:39.097769 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3bfd8-a2a3-4bb2-8650-bf28b2efa7f8 admin admin] PATH_INFO: `/v3/projects/a382ccd5089b438f9eb9a963f5f7d1a1/users/6b1dc0e2cd1842ac98387af40127dc0f/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:39.100159 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3bfd8-a2a3-4bb2-8650-bf28b2efa7f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a382ccd5089b438f9eb9a963f5f7d1a1, user_id=6b1dc0e2cd1842ac98387af40127dc0f, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:39.103707 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3bfd8-a2a3-4bb2-8650-bf28b2efa7f8 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:39.117532 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1371/2776] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:32:39 2021] PUT /identity/v3/projects/a382ccd5089b438f9eb9a963f5f7d1a1/users/6b1dc0e2cd1842ac98387af40127dc0f/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:32:43.894884 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:43.975526 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b134633-fdd5-4ba8-bc6c-d809dff58efd admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:44.041779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:44.042487 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:44.042778 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:44.043068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:44.045048 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:44.070968 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71af6-8269-4a81-9adc-2c02a9ec7e66 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:44.071446 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71af6-8269-4a81-9adc-2c02a9ec7e66 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:44.071526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d71af6-8269-4a81-9adc-2c02a9ec7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:44.101760 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b7d71af6-8269-4a81-9adc-2c02a9ec7e66 None None] MFA Rules not processed for user `6b1dc0e2cd1842ac98387af40127dc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:44.103101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b7d71af6-8269-4a81-9adc-2c02a9ec7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:44.116191 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:44.117673 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:44.128502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1406/2777] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:43 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:44.184539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1372/2778] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:44 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:32:44.197897 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:44.199742 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:44.285668 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa646da-93b7-4652-bce3-9dd2c790768c service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:44.299052 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:44.300817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:44.301124 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:44.301418 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:44.376283 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:44.377919 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:44.388302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1407/2779] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:44 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:32:45.862460 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:45.863090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:45.863090 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:45.882314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] MFA Rules not processed for user `d2457318b0094619b0fd1499f2c5732d`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:32:45.883665 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:45.891455 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1373/2780] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:32:45 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:32:45.983498 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:32:45.986807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:46.006728 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704365f5-be7a-4e1c-b2aa-f67a9a3147e3 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:32:46.013183 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:32:46.014129 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:32:46.014423 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:32:46.014707 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:32:46.016637 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:32:46.037766 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:32:46.040505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267ac77-1ee2-4ef4-8221-a1810e51368f service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:32:46.058962 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1408/2781] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:32:45 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:33:31.230113 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:31.231568 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:31.298456 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf36a52-8bbf-4673-905e-de4fee5485b3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:31.304561 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:31.305503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:31.305850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:31.306189 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] PATH_INFO: `/v3/users/edd088ca791b4a4489e513b31007ae5d` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:31.307539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd088ca791b4a4489e513b31007ae5d)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:31.309584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:31.366670 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd088ca791b4a4489e513b31007ae5d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:31.380074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd088ca791b4a4489e513b31007ae5d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:31.381047 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd088ca791b4a4489e513b31007ae5d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:31.394000 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd088ca791b4a4489e513b31007ae5d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:31.400748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd088ca791b4a4489e513b31007ae5d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:31.406525 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1374/2782] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:33:31 2021] DELETE /identity/v3/users/edd088ca791b4a4489e513b31007ae5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:33:31.411972 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:31.412996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:31.413111 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:31.429990 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:33:31.431202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:31.493988 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1409/2783] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:33:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:33:31.503960 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:31.505354 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:31.587067 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217bc6c-86da-49f5-95f0-e5ef1480afd3 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:31.590880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5a1f2-a759-4aeb-a437-677b3d4cf0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:31.591474 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5a1f2-a759-4aeb-a437-677b3d4cf0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:31.591807 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5a1f2-a759-4aeb-a437-677b3d4cf0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:31.592089 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5a1f2-a759-4aeb-a437-677b3d4cf0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:31.602386 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5a1f2-a759-4aeb-a437-677b3d4cf0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:31.604032 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5a1f2-a759-4aeb-a437-677b3d4cf0b8 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:31.614484 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1375/2784] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:33:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:33:31.939224 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:31.941307 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:31.960868 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad48b5-5052-46dc-9592-066f88895600 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:31.973689 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:31.974580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:31.974882 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:31.975375 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] PATH_INFO: `/v3/projects/a0b68818a05f440ab5e5f388fa37cc30` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:31.976853 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b68818a05f440ab5e5f388fa37cc30)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:31.979056 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.041262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b68818a05f440ab5e5f388fa37cc30', 'request_id': 'req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:32.049289 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b68818a05f440ab5e5f388fa37cc30', 'request_id': 'req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:32.057700 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b68818a05f440ab5e5f388fa37cc30', 'request_id': 'req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:32.069985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] The token cache is being invalidate because project a0b68818a05f440ab5e5f388fa37cc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:33:32.070406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:32.071153 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-434f8e5c-4a25-4f01-ae5c-ebf75cb6239d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:33:32.072888 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1410/2785] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:33:31 2021] DELETE /identity/v3/projects/a0b68818a05f440ab5e5f388fa37cc30 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:33:32.078554 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.079062 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.079526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.099253 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:33:32.100845 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:32.158773 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1376/2786] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:33:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:33:32.166725 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.167015 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.167296 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.185889 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:33:32.187253 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:32.196572 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1411/2787] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:33:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:33:32.201610 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.213753 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca48d5-9002-4c8b-af4d-6eb6953b757b None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.218576 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.219415 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.219895 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.220325 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.221228 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79032) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:33:32.221688 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.223432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.235352 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1377/2788] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:33:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 09 05:33:32.239816 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.249744 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0d525-11a6-42e8-835e-d6617d5a6275 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.254438 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.255096 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.255378 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.255684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.256963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.258839 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.284528 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1412/2789] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:33:32 2021] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:33:32.288573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.298520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e427460-aaa4-46a6-96d6-dce859a01ae5 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.353022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.354099 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.354573 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.354860 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.355804 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.357740 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.381257 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1378/2790] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:33:32 2021] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:33:32.383243 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.393788 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a112-ee13-4ceb-b1cb-5889c5a292cb admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.398830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.399827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.399827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.400194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.400850 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.402447 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.417666 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1413/2791] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:33:32 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:33:32.420875 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.435048 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c80b4-8e5a-4507-8910-b48f578a9775 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.440723 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e47cf-437c-4d09-ac16-52d3aeabdb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.441539 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e47cf-437c-4d09-ac16-52d3aeabdb5f admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.441922 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e47cf-437c-4d09-ac16-52d3aeabdb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.442297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e47cf-437c-4d09-ac16-52d3aeabdb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.443146 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e47cf-437c-4d09-ac16-52d3aeabdb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.445552 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e47cf-437c-4d09-ac16-52d3aeabdb5f admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.458702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1379/2792] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:33:32 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:33:32.462852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.473726 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbdd95-d27c-46f3-896e-7e732235032b admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.482276 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.483198 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.483486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.483801 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] PATH_INFO: `/v3/projects/e4a4eed6ce744b8897eb5b5006dfe232/users/0424fa02728443afb103d4992a481a22/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.503522 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a4eed6ce744b8897eb5b5006dfe232, user_id=0424fa02728443afb103d4992a481a22, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.506805 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.531713 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1414/2793] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:33:32 2021] PUT /identity/v3/projects/e4a4eed6ce744b8897eb5b5006dfe232/users/0424fa02728443afb103d4992a481a22/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:33:32.534236 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.534534 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.534837 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.579724 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] MFA Rules not processed for user `0424fa02728443afb103d4992a481a22`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:33:32.581198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:32.655944 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1380/2794] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:33:32 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:33:32.665453 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:32.667969 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:32.765540 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dc19c-c415-42a6-9be3-cae216f83d0e admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:32.769228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:32.769885 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:32.770170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:32.770450 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:32.779880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:32.781486 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:32.793256 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1415/2795] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:33:32 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:33:49.410797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:33:49.412205 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:49.467856 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b7f7b-72fa-41b4-9d77-222efa61af30 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:33:49.471466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:33:49.472104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:33:49.472390 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:33:49.472669 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:33:49.474434 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:33:49.535353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:33:49.536812 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd60b7-7235-46e8-b48c-ad1efe053a86 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:33:49.546025 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1381/2796] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:33:49 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:34:16.693172 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:34:16.752083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981087c-7e40-44cf-b6e0-b0c455aa853e service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:34:16.756534 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:34:16.757386 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:34:16.757733 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:34:16.758011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] PATH_INFO: `/v3/users/0424fa02728443afb103d4992a481a22` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:34:16.759202 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0424fa02728443afb103d4992a481a22)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:34:16.761138 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:34:16.805548 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0424fa02728443afb103d4992a481a22'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:16.816760 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0424fa02728443afb103d4992a481a22'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:16.817407 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0424fa02728443afb103d4992a481a22'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:16.818005 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0424fa02728443afb103d4992a481a22'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:16.824821 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0424fa02728443afb103d4992a481a22'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:16.836891 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1416/2797] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:34:16 2021] DELETE /identity/v3/users/0424fa02728443afb103d4992a481a22 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:34:16.841347 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:34:16.841830 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:34:16.841926 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:34:16.859660 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:34:16.860835 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:34:16.918071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1382/2798] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:34:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:34:16.927828 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:34:16.929228 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:34:16.983359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc4d5-e3e0-43ac-a042-b76a19ebe89c admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:34:16.987028 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:34:16.987691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:34:16.987986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:34:16.988265 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:34:16.997395 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:34:16.998813 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:34:17.008449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1417/2799] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:34:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:34:17.257085 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:34:17.259125 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:34:17.271026 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8958b94-603d-4f7a-8a85-fab074f3fcaa None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:34:17.276940 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:34:17.277831 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:34:17.278119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:34:17.278394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] PATH_INFO: `/v3/projects/e4a4eed6ce744b8897eb5b5006dfe232` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:34:17.279613 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a4eed6ce744b8897eb5b5006dfe232)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:34:17.281788 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:34:17.329037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a4eed6ce744b8897eb5b5006dfe232', 'request_id': 'req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:17.335097 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a4eed6ce744b8897eb5b5006dfe232', 'request_id': 'req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:17.342247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a4eed6ce744b8897eb5b5006dfe232', 'request_id': 'req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:17.352180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] The token cache is being invalidate because project e4a4eed6ce744b8897eb5b5006dfe232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:34:17.352412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:17.353036 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:34:17.354551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1383/2800] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:34:17 2021] DELETE /identity/v3/projects/e4a4eed6ce744b8897eb5b5006dfe232 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:34:32.763737 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:34:32.772254 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063a7b-9374-4b4d-a684-ae5463c8cd7d service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:34:32.819684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:34:32.820266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:34:32.820552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:34:32.820827 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:34:32.822600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:34:32.903381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:34:32.904858 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7bb1b-b439-4fb0-905f-737a74e8ed80 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:34:32.925825 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1418/2801] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:34:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:34:34.218046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:34:34.219429 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:34:34.231877 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e465ff9-e4af-4460-a2ab-bdd916ec04d4 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:34:34.235375 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:34:34.236035 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:34:34.236320 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:34:34.236595 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:34:34.238247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:34:34.251149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:34:34.252594 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:34:34.263142 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1384/2802] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:34:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:36:00.922552 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac987c-b056-47be-850f-99b79aa940de None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:00.923034 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac987c-b056-47be-850f-99b79aa940de None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:00.923131 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac987c-b056-47be-850f-99b79aa940de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:00.940012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-92ac987c-b056-47be-850f-99b79aa940de None None] MFA Rules not processed for user `65bdf4f5171f4c4e8a4eca9592fc880e`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:00.941204 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-92ac987c-b056-47be-850f-99b79aa940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:00.993900 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1419/2803] 10.222.0.41 () {58 vars in 967 bytes} [Tue Nov 9 05:36:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:36:01.035432 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:01.036870 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:01.103735 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d14d30-4354-4e4f-adfd-fb0ad44b35c2 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:01.108718 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b400457cc4a343f6a25e43f6d24edc42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:01.109364 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:01.109650 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:01.109936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:01.117663 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:01.119507 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:01.127169 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1385/2804] 10.222.0.41 () {60 vars in 1384 bytes} [Tue Nov 9 05:36:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 09 05:36:07.694424 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac987c-b056-47be-850f-99b79aa940de None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:07.696218 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-92ac987c-b056-47be-850f-99b79aa940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:07.768601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac987c-b056-47be-850f-99b79aa940de None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:07.773027 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:07.773791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:07.774075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:07.774449 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] PATH_INFO: `/v3/users/52a9719a05fc4cc79e9096ae8746c382` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:07.775867 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a9719a05fc4cc79e9096ae8746c382)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:07.777817 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:07.827319 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a9719a05fc4cc79e9096ae8746c382'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:07.839280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a9719a05fc4cc79e9096ae8746c382'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:07.840173 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a9719a05fc4cc79e9096ae8746c382'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:07.840706 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a9719a05fc4cc79e9096ae8746c382'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:07.847965 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a9719a05fc4cc79e9096ae8746c382'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:07.860467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1420/2805] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:36:07 2021] DELETE /identity/v3/users/52a9719a05fc4cc79e9096ae8746c382 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:36:08.025277 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.035465 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd066817-c5e7-4ed6-ba38-6a5f6be4d362 service swift] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.088794 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.089659 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.089941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.090217 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] PATH_INFO: `/v3/projects/00555c9dc6b94b048368752dc235deba` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.091459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00555c9dc6b94b048368752dc235deba)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.093379 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.139084 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00555c9dc6b94b048368752dc235deba', 'request_id': 'req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.145126 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00555c9dc6b94b048368752dc235deba', 'request_id': 'req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.154334 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00555c9dc6b94b048368752dc235deba', 'request_id': 'req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.164522 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] The token cache is being invalidate because project 00555c9dc6b94b048368752dc235deba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:36:08.164816 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.165986 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.167487 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1386/2806] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:36:08 2021] DELETE /identity/v3/projects/00555c9dc6b94b048368752dc235deba => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:36:08.171493 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.172904 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:08.185517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7c74-aac2-4f24-b75d-32fc42baa2b5 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.239231 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.240065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.240354 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.240630 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] PATH_INFO: `/v3/users/a655ced1dbb04d528f7b545e54515bc9` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.241841 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a655ced1dbb04d528f7b545e54515bc9)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.244037 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.286477 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a655ced1dbb04d528f7b545e54515bc9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.298385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a655ced1dbb04d528f7b545e54515bc9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.299080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a655ced1dbb04d528f7b545e54515bc9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.299732 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a655ced1dbb04d528f7b545e54515bc9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.307379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-81c45b42-1c2e-4c21-bee7-241cb1450504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a655ced1dbb04d528f7b545e54515bc9'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.319388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1421/2807] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:36:08 2021] DELETE /identity/v3/users/a655ced1dbb04d528f7b545e54515bc9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:36:08.497744 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.499188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:08.511752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42060f3-b917-47ae-ad4e-f4277c5c2f0a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.566683 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.567544 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.567854 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.568139 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] PATH_INFO: `/v3/projects/5d514b0df89d41d792d7672ec1168628` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.569328 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d514b0df89d41d792d7672ec1168628)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.571225 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.619195 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d514b0df89d41d792d7672ec1168628', 'request_id': 'req-42928565-1066-4b9f-b91f-08ba4ee79a06'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.625380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d514b0df89d41d792d7672ec1168628', 'request_id': 'req-42928565-1066-4b9f-b91f-08ba4ee79a06'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.632571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d514b0df89d41d792d7672ec1168628', 'request_id': 'req-42928565-1066-4b9f-b91f-08ba4ee79a06'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.642891 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] The token cache is being invalidate because project 5d514b0df89d41d792d7672ec1168628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79032) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:36:08.643186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.643850 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-42928565-1066-4b9f-b91f-08ba4ee79a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:36:08.645353 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1387/2808] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:36:08 2021] DELETE /identity/v3/projects/5d514b0df89d41d792d7672ec1168628 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:36:08.651068 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.651361 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.651664 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.669491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:08.670694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:08.726986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1422/2809] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:36:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:36:08.735246 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.735527 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.735833 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.762185 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:08.763311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:08.773750 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1388/2810] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:36:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:36:08.778613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.788417 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166bf13-16db-4e7e-991d-f1b55fdfc1d9 None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.793754 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.794414 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.794705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.794987 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.795779 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79031) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 09 05:36:08.796094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.797749 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.809638 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1423/2811] 10.222.0.41 () {58 vars in 1152 bytes} [Tue Nov 9 05:36:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 09 05:36:08.813693 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.822963 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98e14b-709c-4f65-8986-52225ce8a3de None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.827564 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.828232 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.828516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.828791 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.829503 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.831408 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.856890 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1389/2812] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:36:08 2021] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:36:08.860768 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.871462 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22993-f5bd-4952-885d-b960c0e3efc9 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.926425 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.927094 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.927384 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.927698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.928416 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.930321 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.949244 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1424/2813] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:36:08 2021] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:36:08.953315 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.963921 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c52cca-5b6f-4770-baa9-a65a90c4eaa1 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:08.968598 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:08.969248 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:08.969537 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:08.969818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] PATH_INFO: `/v3/roles` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:08.970572 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:08.972186 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:08.982840 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1390/2814] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:36:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:36:08.986502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:08.997337 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f15de-f301-40c3-a807-ae93522d5cd0 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:09.002369 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b394c0f-67bc-4e43-9d71-708de5c8f6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:09.003030 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394c0f-67bc-4e43-9d71-708de5c8f6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:09.003320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394c0f-67bc-4e43-9d71-708de5c8f6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:09.003603 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b394c0f-67bc-4e43-9d71-708de5c8f6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:09.004379 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394c0f-67bc-4e43-9d71-708de5c8f6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:09.005963 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b394c0f-67bc-4e43-9d71-708de5c8f6cc admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:09.016241 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1425/2815] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:36:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:36:09.020380 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:09.030678 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0aa4e-0152-4a2d-840f-2f80c222e335 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:09.035491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:09.036410 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:09.036694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:09.036972 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] PATH_INFO: `/v3/projects/3fdba2411572461f8bf1e42d4eac42db/users/0e16463bf33240d8835e67a27448cdc9/roles/304db4839fd8407ea7f2e75407363716` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:09.053733 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdba2411572461f8bf1e42d4eac42db, user_id=0e16463bf33240d8835e67a27448cdc9, role_id=304db4839fd8407ea7f2e75407363716)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:09.056745 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:09.069297 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1391/2816] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:36:09 2021] PUT /identity/v3/projects/3fdba2411572461f8bf1e42d4eac42db/users/0e16463bf33240d8835e67a27448cdc9/roles/304db4839fd8407ea7f2e75407363716 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:36:09.074644 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:09.074939 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:09.075217 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:09.093580 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] MFA Rules not processed for user `dce917494d344377a020b14e93b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:09.094940 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:09.162371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1426/2817] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:36:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:36:09.172674 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:09.176327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:09.235839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b51f42-20cf-49ef-936c-f3dcf881a706 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:09.240017 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28451cb4-c8db-4e18-ae4e-ceb01ab03eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:09.240667 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28451cb4-c8db-4e18-ae4e-ceb01ab03eea service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:09.240952 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28451cb4-c8db-4e18-ae4e-ceb01ab03eea service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:09.241237 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28451cb4-c8db-4e18-ae4e-ceb01ab03eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:09.250905 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28451cb4-c8db-4e18-ae4e-ceb01ab03eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:09.252412 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28451cb4-c8db-4e18-ae4e-ceb01ab03eea service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:09.262229 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1392/2818] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:36:13.084608 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.086287 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:13.217341 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f372450-f52c-40a6-96d2-04752cb16a3e None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.225071 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.225986 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.227046 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.227517 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.229948 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:13.248003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.250857 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.268978 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1427/2819] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:13 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:36:13.344201 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.345917 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.346209 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.386502 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] MFA Rules not processed for user `0e16463bf33240d8835e67a27448cdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:13.388013 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:13.477820 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1393/2820] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:36:13 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:36:13.482270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.493844 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81e59b-f3fe-4035-baf3-941a53365e36 service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.502985 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.503859 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.504269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.504622 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.505440 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.507729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.545876 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1428/2821] 10.222.0.41 () {60 vars in 1152 bytes} [Tue Nov 9 05:36:13 2021] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 09 05:36:13.549898 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.561215 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f00a90-8d93-4888-93a1-831712cc18a3 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.621880 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.622671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.623028 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.623367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] PATH_INFO: `/v3/users` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.624188 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.626369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.646074 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1394/2822] 10.222.0.41 () {60 vars in 1143 bytes} [Tue Nov 9 05:36:13 2021] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 09 05:36:13.650750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.661119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a2536-61d1-40a9-89ad-2c848dcb63a1 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.666360 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.667032 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.667316 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.667594 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.668382 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.669981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.681106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1429/2823] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:36:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:36:13.685312 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.695428 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b5840-cab9-43e9-afaf-9e9f46c97ecc admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.700180 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.701071 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.701357 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.701637 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] PATH_INFO: `/v3/projects/298bebc45f214912a90f689c1002f289/users/f894afc4de1e4965a8a270d0c5702b2d/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.717743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] RBAC: Authorizing `identity:create_grant(project_id=298bebc45f214912a90f689c1002f289, user_id=f894afc4de1e4965a8a270d0c5702b2d, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.720499 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.734617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1395/2824] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:36:13 2021] PUT /identity/v3/projects/298bebc45f214912a90f689c1002f289/users/f894afc4de1e4965a8a270d0c5702b2d/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:36:13.738674 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.749286 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfba79-50cc-44c7-a0b9-827a0c61f4e2 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.832525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd8f8fa-6ed5-491c-a7c3-681a9ff67a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.833330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f8fa-6ed5-491c-a7c3-681a9ff67a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.833677 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f8fa-6ed5-491c-a7c3-681a9ff67a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.834042 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd8f8fa-6ed5-491c-a7c3-681a9ff67a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.834886 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f8fa-6ed5-491c-a7c3-681a9ff67a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.836675 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd8f8fa-6ed5-491c-a7c3-681a9ff67a72 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.848613 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1430/2825] 10.222.0.41 () {58 vars in 1121 bytes} [Tue Nov 9 05:36:13 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 09 05:36:13.852839 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:13.863376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f459a9-c5df-4bc4-b13f-b93ee966620b admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:13.868385 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:13.869271 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] REQUEST_METHOD: `PUT` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:13.869559 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:13.869840 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] PATH_INFO: `/v3/projects/298bebc45f214912a90f689c1002f289/users/f894afc4de1e4965a8a270d0c5702b2d/roles/94424be31c964c5686644e854119e1dc` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:13.871904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=298bebc45f214912a90f689c1002f289, user_id=f894afc4de1e4965a8a270d0c5702b2d, role_id=94424be31c964c5686644e854119e1dc)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:13.874550 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:13.887467 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1396/2826] 10.222.0.41 () {60 vars in 1482 bytes} [Tue Nov 9 05:36:13 2021] PUT /identity/v3/projects/298bebc45f214912a90f689c1002f289/users/f894afc4de1e4965a8a270d0c5702b2d/roles/94424be31c964c5686644e854119e1dc => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:36:18.601926 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a011ec-7122-4f05-80df-c4caebfd7508 None None] REQUEST_METHOD: `POST` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:18.603003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a011ec-7122-4f05-80df-c4caebfd7508 None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:18.603003 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a011ec-7122-4f05-80df-c4caebfd7508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:18.629509 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.auth.core [None req-b8a011ec-7122-4f05-80df-c4caebfd7508 None None] MFA Rules not processed for user `f894afc4de1e4965a8a270d0c5702b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79031) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:18.630696 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b8a011ec-7122-4f05-80df-c4caebfd7508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:18.700510 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1431/2827] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:36:18 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:36:18.712748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:18.714584 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:18.794127 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38954db9-823a-45da-afad-744189c0a63a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:18.800935 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21785ee-cc21-48f6-8d1a-38c32090c72d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:18.801617 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21785ee-cc21-48f6-8d1a-38c32090c72d service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:18.802006 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21785ee-cc21-48f6-8d1a-38c32090c72d service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:18.802495 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21785ee-cc21-48f6-8d1a-38c32090c72d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:18.859234 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21785ee-cc21-48f6-8d1a-38c32090c72d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:18.860878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21785ee-cc21-48f6-8d1a-38c32090c72d service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:18.870528 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1397/2828] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:18 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:36:24.277601 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596c0e-25d1-4978-8f4d-ec1921a09aed None None] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:24.278170 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596c0e-25d1-4978-8f4d-ec1921a09aed None None] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:24.278280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2596c0e-25d1-4978-8f4d-ec1921a09aed None None] PATH_INFO: `/` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:24.280080 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1432/2829] 10.222.0.41 () {54 vars in 921 bytes} [Tue Nov 9 05:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 09 05:36:24.286227 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6481b9-2599-45d9-8f8f-6f48e9dffe8e None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:24.286694 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6481b9-2599-45d9-8f8f-6f48e9dffe8e None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:24.286786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6481b9-2599-45d9-8f8f-6f48e9dffe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:24.323767 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-5d6481b9-2599-45d9-8f8f-6f48e9dffe8e None None] MFA Rules not processed for user `91a0c407ceb84296be75ad28880f64cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:24.325037 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-5d6481b9-2599-45d9-8f8f-6f48e9dffe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:24.375800 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1398/2830] 10.222.0.41 () {58 vars in 1018 bytes} [Tue Nov 9 05:36:24 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 09 05:36:24.387831 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2596c0e-25d1-4978-8f4d-ec1921a09aed None None] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:24.389505 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-e2596c0e-25d1-4978-8f4d-ec1921a09aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:24.402262 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2596c0e-25d1-4978-8f4d-ec1921a09aed None None] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:24.405773 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:24.406409 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:24.406697 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:24.406981 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:24.415054 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:24.417869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:24.426872 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1433/2831] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:36:42.874399 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:42.874855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:42.874941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:42.891948 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] MFA Rules not processed for user `0e16463bf33240d8835e67a27448cdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:36:42.893157 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:42.900376 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1399/2832] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:36:42 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:36:43.200525 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:43.208907 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752ae3b-29da-489c-86ec-6cbb5a4762cc service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:43.212496 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:43.213130 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:43.213419 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:43.213698 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:43.215475 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:43.224691 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:43.226122 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:43.234359 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1434/2833] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:43 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:36:43.748941 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:43.750330 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:43.815458 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb94cf-6798-4e40-a1bb-82d3b27c67a4 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:43.821130 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:43.821774 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:43.822054 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:43.822331 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:43.824314 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:36:43.836369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:43.837929 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:43.847440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1400/2834] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:43 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 09 05:36:58.982491 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:36:58.990838 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafcfd2-e95a-43e1-8365-b50497a2c710 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:36:58.999083 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:36:58.999771 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:36:59.000060 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:36:59.000336 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:36:59.010234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:36:59.011671 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:36:59.021117 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1435/2835] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:36:58 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:37:21.813338 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:37:21.823178 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8ab3-93e9-4727-8e6a-dd365a9674cb service placement] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:37:21.826684 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:37:21.827311 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:37:21.827592 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:37:21.827894 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:37:21.829604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:37:21.838818 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:37:21.840266 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:37:21.848179 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1401/2836] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:37:21 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:38:14.596507 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:14.605456 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d82e35-8999-4e29-b1fe-83e7aba10bc0 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:14.609044 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:14.609672 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:14.609958 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:14.610239 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:14.612010 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:38:14.668288 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:14.669705 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:14.678266 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1436/2837] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:38:14 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:38:15.777782 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:15.791135 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489eeb-b469-47fb-a6ee-73b204a95ff2 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:15.796743 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:15.797398 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:15.797686 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:15.798500 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:15.799815 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:38:15.832287 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:15.833994 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:15.848486 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1402/2838] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:38:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:38:19.652993 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:19.661394 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11280f-2e0c-4ecf-9205-bb19ade773d1 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:19.665001 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:19.665756 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:19.666045 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:19.666410 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:19.682600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:38:19.742866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:19.744338 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:19.753866 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1437/2839] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:38:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:38:26.244088 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:26.246198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:38:26.259878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024e53-1204-49e5-917d-46534f34b1de service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:26.264466 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:26.265323 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:26.265604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:26.265879 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] PATH_INFO: `/v3/users/d2457318b0094619b0fd1499f2c5732d` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:26.267086 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2457318b0094619b0fd1499f2c5732d)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:26.269008 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:26.313045 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2457318b0094619b0fd1499f2c5732d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.321886 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2457318b0094619b0fd1499f2c5732d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.322492 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2457318b0094619b0fd1499f2c5732d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.333748 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2457318b0094619b0fd1499f2c5732d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.340726 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2457318b0094619b0fd1499f2c5732d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.346368 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1403/2840] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:38:26 2021] DELETE /identity/v3/users/d2457318b0094619b0fd1499f2c5732d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:38:26.512955 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:26.523207 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1eca3-d54a-46c4-bff9-2fba2f950b92 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:26.577949 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:26.578807 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:26.579087 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:26.579381 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] PATH_INFO: `/v3/projects/4dc498cab6aa40d2b4929df08abc9e02` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:26.580589 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc498cab6aa40d2b4929df08abc9e02)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:26.582467 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:26.625238 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc498cab6aa40d2b4929df08abc9e02', 'request_id': 'req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.631791 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc498cab6aa40d2b4929df08abc9e02', 'request_id': 'req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.638107 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc498cab6aa40d2b4929df08abc9e02', 'request_id': 'req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.647800 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] The token cache is being invalidate because project 4dc498cab6aa40d2b4929df08abc9e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:38:26.648091 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.648701 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.650856 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1438/2841] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:38:26 2021] DELETE /identity/v3/projects/4dc498cab6aa40d2b4929df08abc9e02 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:38:26.655020 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:26.656479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:38:26.669138 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c280341-4d07-4a0c-b623-618b98b6d877 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:26.722369 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:26.723164 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:26.723449 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:26.723762 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] PATH_INFO: `/v3/users/6b1dc0e2cd1842ac98387af40127dc0f` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:26.724947 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b1dc0e2cd1842ac98387af40127dc0f)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:26.726846 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:26.771609 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b1dc0e2cd1842ac98387af40127dc0f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.778284 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b1dc0e2cd1842ac98387af40127dc0f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.778907 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b1dc0e2cd1842ac98387af40127dc0f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.790367 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b1dc0e2cd1842ac98387af40127dc0f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.797080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-62f8df31-8109-4f08-abc5-d92be626e96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b1dc0e2cd1842ac98387af40127dc0f'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:26.802878 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1404/2842] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:38:26 2021] DELETE /identity/v3/users/6b1dc0e2cd1842ac98387af40127dc0f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:38:26.965343 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:38:26.966952 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:38:26.982734 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a56ef7-ee11-4d2c-a7b0-65cc44b61ec6 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:38:27.037075 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:38:27.037925 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:38:27.038199 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:38:27.038479 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] PATH_INFO: `/v3/projects/a382ccd5089b438f9eb9a963f5f7d1a1` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:38:27.039684 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a382ccd5089b438f9eb9a963f5f7d1a1)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:38:27.041604 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:38:27.084302 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a382ccd5089b438f9eb9a963f5f7d1a1', 'request_id': 'req-f137f0be-5c31-48b2-a00e-00b03ffb8b93'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:27.091012 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a382ccd5089b438f9eb9a963f5f7d1a1', 'request_id': 'req-f137f0be-5c31-48b2-a00e-00b03ffb8b93'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:27.096945 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a382ccd5089b438f9eb9a963f5f7d1a1', 'request_id': 'req-f137f0be-5c31-48b2-a00e-00b03ffb8b93'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:27.107065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] The token cache is being invalidate because project a382ccd5089b438f9eb9a963f5f7d1a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:38:27.107365 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:27.107977 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:38:27.109466 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1439/2843] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:38:26 2021] DELETE /identity/v3/projects/a382ccd5089b438f9eb9a963f5f7d1a1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:39:20.426101 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:39:20.426619 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:39:20.426713 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:39:20.443982 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] MFA Rules not processed for user `0e16463bf33240d8835e67a27448cdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:39:20.445161 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:20.496987 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1405/2844] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:39:20 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:39:20.808869 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:39:20.810255 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:20.864529 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137f0be-5c31-48b2-a00e-00b03ffb8b93 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:39:20.868125 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:39:20.868775 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:39:20.869064 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:39:20.869346 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:39:20.871584 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:20.880718 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:39:20.882140 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:39:20.890439 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1440/2845] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:39:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:39:32.939520 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:39:32.941014 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:32.953526 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc7d56-8330-46ba-a71d-87506b6f9d11 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:39:32.956997 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:39:32.957624 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:39:32.957904 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:39:32.958177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:39:32.959863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:33.028780 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:39:33.030393 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:39:33.041551 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1406/2846] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:39:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:39:33.723480 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:39:33.724980 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:33.741502 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d8235-d898-44b9-84ec-22d3eebdfc6e service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:39:33.747530 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:39:33.748280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:39:33.748780 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:39:33.749293 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:39:33.751729 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:33.767569 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:39:33.769194 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:39:33.780171 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1441/2847] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:39:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:39:35.374262 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:39:35.382909 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f56d2-663c-464e-96bd-428046758a11 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:39:35.386519 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:39:35.387156 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:39:35.387439 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:39:35.387752 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:39:35.389496 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:35.403823 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:39:35.405276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:39:35.417672 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1407/2848] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:39:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:39:38.416031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:39:38.417954 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:38.431642 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894d47d-688a-4893-a0e8-454a163fb5a2 service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:39:38.437106 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:39:38.437750 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:39:38.438036 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:39:38.438320 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:39:38.440104 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:39:38.452031 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:39:38.453600 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:39:38.464280 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1442/2849] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:39:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:41:20.070358 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:41:20.071771 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:20.197366 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d080dbc-6fa1-4089-9d0f-5e90151777e8 service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:41:20.202459 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:41:20.203104 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:41:20.203394 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:41:20.203698 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:41:20.205440 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:20.217046 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:41:20.218625 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a69ccf-c8d6-4dc6-b896-c0da93320cd3 service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:41:20.228797 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1408/2850] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:41:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:41:37.394188 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:41:37.396236 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:37.467145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242a6b-f051-45a8-8fbc-57d7b8647a8b service nova] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:41:37.470694 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e261119c7a194c7e814a9dfbf6a4b10f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:41:37.471329 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:41:37.471614 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:41:37.471927 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:41:37.473656 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:37.483738 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:41:37.485152 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:41:37.494066 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1443/2851] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:41:37 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:41:47.342112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] REQUEST_METHOD: `POST` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:41:47.342596 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:41:47.342691 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:41:47.360636 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.auth.core [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] MFA Rules not processed for user `0e16463bf33240d8835e67a27448cdc9`. Rule list: `[]` (Enabled: `True`). {{(pid=79032) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 09 05:41:47.362119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:47.372087 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1409/2852] 10.222.0.41 () {58 vars in 957 bytes} [Tue Nov 9 05:41:47 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 09 05:41:48.120385 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:41:48.121852 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:48.146996 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b071d1-f9ae-48ce-9615-5c1a254c5812 service cinder] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:41:48.152408 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:41:48.153069 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:41:48.153364 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:41:48.153651 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:41:48.155514 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:41:48.167798 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:41:48.169388 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:41:48.179196 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1444/2853] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:41:48 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:42:04.782112 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:42:04.791444 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a9aeb-04d3-4287-9a05-2d4ec1605211 None None] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:42:04.795105 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:42:04.795786 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:42:04.796072 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:42:04.796350 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:42:04.798080 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:42:04.857356 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:42:04.858784 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:42:04.869863 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1410/2854] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:42:04 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:42:24.487406 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:42:24.502065 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f3a94-71fe-4e62-834a-e3d201a0a5b1 service placement] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:42:24.506880 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:42:24.507092 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:42:24.507643 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:42:24.508167 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:42:24.510704 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:42:24.524893 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:42:24.526490 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:42:24.534411 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1445/2855] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:42:24 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:44:00.396149 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:44:00.418274 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff1d88-04cb-4026-b045-a976dcd3f20c service neutron] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:44:00.424058 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c16b11a1bbac45c0b869734149bd3416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:44:00.425516 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:44:00.425813 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:44:00.426087 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:44:00.428591 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:44:00.452631 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:44:00.454107 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:44:00.466100 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1411/2856] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:44:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:44:10.222234 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:44:10.242330 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64325588-7a1a-4a52-bf13-93a068740345 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:44:10.245979 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91a0c407ceb84296be75ad28880f64cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:44:10.246617 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] REQUEST_METHOD: `GET` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:44:10.246956 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:44:10.247185 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:44:10.249077 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:44:10.328974 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:44:10.330393 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:44:10.349284 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1446/2857] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:44:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 09 05:44:16.605978 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:44:16.607702 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:44:16.632096 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed8fd8-a8df-46ed-ba02-f19233457a60 service nova] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:44:16.636715 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:44:16.637571 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:44:16.637858 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:44:16.638137 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] PATH_INFO: `/v3/users/0e16463bf33240d8835e67a27448cdc9` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:44:16.639332 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e16463bf33240d8835e67a27448cdc9)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:44:16.641276 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:44:16.687119 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e16463bf33240d8835e67a27448cdc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:16.694799 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e16463bf33240d8835e67a27448cdc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:16.695405 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e16463bf33240d8835e67a27448cdc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:16.707160 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e16463bf33240d8835e67a27448cdc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:16.713865 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e16463bf33240d8835e67a27448cdc9'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:16.719763 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1412/2858] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:44:16 2021] DELETE /identity/v3/users/0e16463bf33240d8835e67a27448cdc9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:44:16.885313 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:44:16.895896 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd3836-5d95-4375-a635-c4af5dfc9275 service neutron] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:44:16.950492 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:44:16.951270 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:44:16.951563 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:44:16.951953 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] PATH_INFO: `/v3/projects/3fdba2411572461f8bf1e42d4eac42db` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:44:16.953088 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdba2411572461f8bf1e42d4eac42db)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:44:16.954995 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:44:17.001269 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdba2411572461f8bf1e42d4eac42db', 'request_id': 'req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.008535 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdba2411572461f8bf1e42d4eac42db', 'request_id': 'req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.014561 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdba2411572461f8bf1e42d4eac42db', 'request_id': 'req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.024830 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] The token cache is being invalidate because project 3fdba2411572461f8bf1e42d4eac42db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:44:17.025119 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.025739 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.027233 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1447/2859] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:44:16 2021] DELETE /identity/v3/projects/3fdba2411572461f8bf1e42d4eac42db => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:44:17.031177 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:44:17.032597 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:44:17.045721 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1a3a6-5336-46cd-abac-a46a16c01722 admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:44:17.098689 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:44:17.099549 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:44:17.099855 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:44:17.100128 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] PATH_INFO: `/v3/users/f894afc4de1e4965a8a270d0c5702b2d` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:44:17.101300 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f894afc4de1e4965a8a270d0c5702b2d)` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:44:17.103198 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:44:17.145692 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f894afc4de1e4965a8a270d0c5702b2d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.152604 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f894afc4de1e4965a8a270d0c5702b2d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.153247 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f894afc4de1e4965a8a270d0c5702b2d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.165491 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f894afc4de1e4965a8a270d0c5702b2d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.172216 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.notifications [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f894afc4de1e4965a8a270d0c5702b2d'} {{(pid=79032) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.177956 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1413/2860] 10.222.0.41 () {58 vars in 1223 bytes} [Tue Nov 9 05:44:17 2021] DELETE /identity/v3/users/f894afc4de1e4965a8a270d0c5702b2d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 09 05:44:17.341546 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Authenticating user token {{(pid=79031) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:44:17.343011 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.fernet_utils [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79031) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:44:17.355435 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ebba9-6eaf-4966-a96a-b70bf25e4c98 admin admin] Validating token access rules against request {{(pid=79031) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:44:17.420499 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dce917494d344377a020b14e93b0e3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98146912a4594b47b6620b2e1ee83d93', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79031) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:44:17.421371 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:44:17.421655 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:44:17.421936 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] PATH_INFO: `/v3/projects/298bebc45f214912a90f689c1002f289` {{(pid=79031) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:44:17.423145 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=298bebc45f214912a90f689c1002f289)` {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:44:17.425109 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] RBAC: Authorization granted {{(pid=79031) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:44:17.472275 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298bebc45f214912a90f689c1002f289', 'request_id': 'req-1ca46694-b4e6-4043-bb72-be82f8c82c7c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.479391 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298bebc45f214912a90f689c1002f289', 'request_id': 'req-1ca46694-b4e6-4043-bb72-be82f8c82c7c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.485782 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298bebc45f214912a90f689c1002f289', 'request_id': 'req-1ca46694-b4e6-4043-bb72-be82f8c82c7c'} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.496903 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] The token cache is being invalidate because project 298bebc45f214912a90f689c1002f289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79031) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 09 05:44:17.497192 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.497836 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: DEBUG keystone.notifications [None req-1ca46694-b4e6-4043-bb72-be82f8c82c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79031) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 09 05:44:17.499344 dv-cinder-817135-2-iscsi devstack@keystone.service[79031]: [pid: 79031|app: 0|req: 1448/2861] 10.222.0.41 () {58 vars in 1232 bytes} [Tue Nov 9 05:44:17 2021] DELETE /identity/v3/projects/298bebc45f214912a90f689c1002f289 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 09 05:46:27.056590 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Authenticating user token {{(pid=79032) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 09 05:46:27.058472 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:46:27.125567 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d797f02-e690-444c-8da6-558f4d1c018a admin admin] Validating token access rules against request {{(pid=79032) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 09 05:46:27.181022 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2a6d780d4ee491b933e0eac87c13593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8d21a9b5f9fc484b85f6835d9dfddc26', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79032) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 09 05:46:27.181671 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] REQUEST_METHOD: `GET` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 09 05:46:27.181955 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] SCRIPT_NAME: `/identity` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 09 05:46:27.182233 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79032) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 09 05:46:27.184479 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.fernet_utils [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79032) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 09 05:46:27.195327 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 09 05:46:27.196936 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb2c30-89d9-4710-a6bf-668db24e267a service placement] RBAC: Authorization granted {{(pid=79032) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 09 05:46:27.207027 dv-cinder-817135-2-iscsi devstack@keystone.service[79032]: [pid: 79032|app: 0|req: 1414/2862] 10.222.0.41 () {60 vars in 1365 bytes} [Tue Nov 9 05:46:27 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)